Visual cortex

The brain is the most complicated object in the universe. This is the story of scientists’ quest to decode it – and read people’s minds

Retrieved on: 
Wednesday, February 7, 2024

This is the closest science has yet come to reading someone’s mind.

Key Points: 
  • This is the closest science has yet come to reading someone’s mind.
  • As Alexander Huth, the neuroscientist who co-led the research, told the New York Times:
    This isn’t just a language stimulus.
  • In the longer term, this could lead to wider public applications such as fitbit-style health monitors for the brain and brain-controlled smartphones.
  • On January 29, Elon Musk announced that his Neuralink tech startup had implanted a chip in a human brain for the first time.

Humanity’s greatest mapping challenge

  • By fully mapping the structure and function of a healthy human brain, we can determine with great precision what goes awry in diseases of the brain and mind.
  • Similar initiatives were launched in Europe in 2013 (the Human Brain Project) and China in 2016 (the China Brain Project).
  • This daunting endeavour may still take generations to complete – but the scientific ambition of mapping and reading people’s brains dates back more than two centuries.
  • With the world having been circumnavigated many times over, Antarctica discovered and much of the planet charted, humanity was ready for a new (and even more complicated) mapping challenge – the human brain.
  • In the 1860s, “locationist” views of how the brain worked made a comeback – though the scientists leading this research were keen to distinguish their theories from phrenology.
  • French anatomist Paul Broca discovered a region of the left hemisphere responsible for producing speech – thanks in part to his patient, Louis Victor Leborgne, who at age 30 lost the ability to say anything other than the syllable “tan”.
  • This approach depends on the findings of American physiologist John Fulton almost a century ago.
  • This stronger pulse of activity was not replicated by other sensory inputs, for example when smelling tobacco or vanilla.

The first clinical trial

  • The ultimate goal is wireless, non-invasive devices that help patients communicate and move with precision in the real world.
  • In 2004, BrainGate began the first clinical trial using BCIs to enable patients with impaired motor systems (including spinal cord injuries, brainstem infarctions, locked-in syndrome and muscular dystrophy) control a computer cursor with their thoughts.
  • The team is working with academics from different backgrounds who have been engaged in projects aimed at tackling societal and scientific challenges.
  • Patient MN, a quadriplegic since being stabbed in the neck in 2001, was the trial’s first patient.
  • In addition, brain activity was linked to the patient’s prosthetic hand and robotic arm, enabling rudimentary actions including grasping and transporting an object.
  • Also in 2017, BrainGate clinical trials reported the first evidence that BCIs could be used to help patients regain movement of their own limbs by bypassing the damaged portion of the spinal cord.

A new era of ‘mind reading’ technology

  • But having been primarily envisaged as a tool for diagnostics and monitoring, it is now also a core element of the latest neural communication and prosthetic devices.
  • Despite being behaviourally non-responsive and minimally conscious, these patients were able to answer yes-or-no questions just by using their minds.
  • Now, a decade on, the HuthLab research at the University of Texas constitutes a paradigmatic shift in the evolution of communication-enabling neuroimaging systems.
  • Whereas the brain’s capacity to produce motor intentions is shared across species, the ability to produce and perceive language is uniquely human.
  • The disadvantage of fMRI is that it can only take slow measurements of brain signals (typically, one brain volume every two or three seconds).
  • They demonstrated that the system could be used not only to decode semantic content entertained through auditive perception, but also through visual perception.
  • Importantly, they also explicitly addressed the potential threat to a person’s mental privacy posed by this kind of technology.
  • We take very seriously the concerns that it could be used for bad purposes and have worked to avoid that.

The ethical implications are immense

  • Losing the ability to communicate is a deep cut to one’s sense of self.
  • The ethical implications of providing access to such data to scientific and corporate entities are potentially immense.
  • For example, Parkinson’s disease, a neurodegenerative disease that affects movement, is co-morbid with dementia, which affects the ability to reason and think clearly.
  • In line with this approach, Chile was the first country that adopted legislation to address the risks inherent to neurotechnology.
  • One of the cornerstones of ethical research is the principle of informed consent.
  • The growing availability of neurotechnology in a commercial context that is generally subject to far less regulation only amplifies these ethical and legal concerns.
  • We are at an early stage of technological development and as we begin to uncover the great potential of BCI, both for therapeutic applications and beyond, the need to consider these ethical questions and their implications for legal action becomes more pressing.

Decoding our neuro future

  • By the middle of 2021, the total investment in neurotechnology companies amounted to just over US$33 billion (around £26 million).
  • The implant is said to include 1,024 electrodes, yet is only slightly larger than the diameter of a red blood cell.
  • The Kernel Flow, for example, is a commercially available, wearable headset that uses fNRIS technology to monitor brain activity.
  • The dawn of a new era of brain-computer interfaces should be treated with great care and great respect – in acknowledgement of its immense potential to both help, and harm, our future generations.


For you: more from our Insights series:
Unlocking new clues to how dementia and Alzheimer’s work in the brain – Uncharted Brain podcast series

Freedom of thought is being threatened by states, big tech and even ourselves. Here’s what we can do to protect it

OCD is so much more than handwashing or tidying. As a historian with the disorder, here’s what I’ve learned

Noise in the brain enables us to make extraordinary leaps of imagination. It could transform the power of computers too

To hear about new Insights articles, join the hundreds of thousands of people who value The Conversation’s evidence-based news. Subscribe to our newsletter.
Stephanie Sheir received funding from the EPSRC (grant number EP/V026518/1). Timo Istace receives funding from Fonds Wetenschappelijk Onderzoek Vlaanderen. Nicholas J. Kelley does not work for, consult, own shares in or receive funding from any company or organisation that would benefit from this article, and has disclosed no relevant affiliations beyond their academic appointment.

New study sheds light on how our brains perceive -- or fail to perceive -- what we see

Retrieved on: 
Saturday, November 18, 2023

SEATTLE, Nov. 13, 2023 /PRNewswire/ -- A new study out today in Nature Neuroscience on visual masking sheds light on how we unsee things and points to how conscious perception is generated in the brain.

Key Points: 
  • The study narrows down the parts of the brain responsible for awareness of the world around us.
  • In a phenomenon known as visual masking, individuals don't consciously perceive an image if another image is shown in quick succession.
  • Human perception (or lack thereof) and mouse perception of this specific visual masking illusion turned out to be very similar.
  • That result means that conscious perception is happening either in the visual cortex or in higher areas of the cortex downstream of it.

What makes us human? Detailed cellular maps of the entire human brain reveal clues

Retrieved on: 
Thursday, October 12, 2023

SEATTLE, Oct. 12, 2023 /PRNewswire/ -- Scientists have just unveiled a massive effort to understand our own brains and those of our closest primate relatives.

Key Points: 
  • It's a huge leap from previously published work, with studies and data that reveal new insights about our nervous systems' cellular makeup across many regions of the brain and what is distinctive about the human brain.
  • It was brought together and is funded by the National Institutes of Health's Brain Research Through Advancing Innovative Neurotechnologies ® (BRAIN) Initiative.
  • Where the single region studies found over 100 different brain cell types, the newly released data shows thousands of different kinds of brain cells across the entire brain.
  • This was one of the first human brain studies to compare a large number of individual people using single-cell techniques.

Vivani Medical Subsidiary Cortigent to Present Orion Clinical Study Results at The Eye and The Chip World Research Congress on Artificial Vision October 8-10

Retrieved on: 
Tuesday, September 5, 2023

Vivani Medical, Inc. (NASDAQ: VANI), an innovative, preclinical-stage biopharmaceutical company developing novel, long-term drug implants, announced today that its wholly-owned subsidiary Cortigent, Inc., a company pioneering targeted neurostimulation technology to recover critical body functions, will present the Early Feasibility Study (EFS) results for the Orion® Visual Cortical Prosthesis System at The Eye & The Chip: 13th World Research Congress on Artificial Vision in Southfield, Michigan on October 8-10, 2023.

Key Points: 
  • Vivani Medical, Inc. (NASDAQ: VANI), an innovative, preclinical-stage biopharmaceutical company developing novel, long-term drug implants, announced today that its wholly-owned subsidiary Cortigent, Inc., a company pioneering targeted neurostimulation technology to recover critical body functions, will present the Early Feasibility Study (EFS) results for the Orion® Visual Cortical Prosthesis System at The Eye & The Chip: 13th World Research Congress on Artificial Vision in Southfield, Michigan on October 8-10, 2023.
  • Cortigent’s Principal Investigator for the National Institutes of Health - funded Orion EFS (UH3NS103442), Uday Patel Ph.D., will give a talk covering the abstract “Orion Visual Cortical Prosthesis System: 5-year Clinical Trial Results” that has been accepted by this preeminent research congress focused on recent advances in nanoelectronics and neurobiology to provide artificial vision.
  • The Orion EFS has been extended to a six-year study to assess the long-term safety, reliability, and visual function provided by this novel medical device, and to allow exploration of novel techniques to further improve efficacy.
  • The Orion System is an investigational device that will require successful completion of one or more pivotal clinical trial(s) and subsequent U.S. Food and Drug Administration (FDA) approval for commercialization.

Andrej Karpathy Earns WTF Innovators Award

Retrieved on: 
Wednesday, June 28, 2023

SALT LAKE CITY, June 28, 2023 /PRNewswire/ -- QuHarrison Terry presents Andrej Karpathy with the WTF Innovators Award for his contributions to deep neural networks and computer vision, and continued research into making AI more effective for humanity.

Key Points: 
  • SALT LAKE CITY, June 28, 2023 /PRNewswire/ -- QuHarrison Terry presents Andrej Karpathy with the WTF Innovators Award for his contributions to deep neural networks and computer vision, and continued research into making AI more effective for humanity.
  • The WTF Innovators Award recognizes excellence at the precipice of societal change, with the inaugural class focusing on AI innovators.
  • We present "Andrej Slide", produced by Nimso , to Andrej Karpathy.
  • Andrej Karpathy later created the first deep learning class at Stanford, CS231n, which still runs today and is one of the largest classes at Stanford.

How much energy do we expend thinking and using our brain?

Retrieved on: 
Tuesday, April 25, 2023

But does our brain burn more energy when engaging in mental athletics than it does during other activities, such as watching TV?

Key Points: 
  • But does our brain burn more energy when engaging in mental athletics than it does during other activities, such as watching TV?
  • Tracing brain energy consumption can be done using both sugar and oxygen, but oxygen is the more accessible option.
  • Tracing oxygen consumption, the brain accounts for about 20% of the body’s energy consumption, despite only representing 2% of its weight.

How do we know?

    • We can’t measure brain energy consumption in humans in this way, but we can follow the oxygen, as increased brain activity requires more oxygen.
    • Research indeed shows increased mental load (such as performing mental arithmetic, reasoning, or multitasking) is linked to increased oxygen consumption (measured via CO₂ release).

Can we measure oxygen use just in the brain?

    • That extra supply of oxygen-rich blood is region specific and can be (literally) channelled with micrometre precision to active neurons.
    • Since blood and its oxygen are weakly attracted by magnetic fields, we can use MRI (magnetic resonance imaging), a radiation-free tool, to obtain an, albeit indirect, measure of brain activity.
    • But unfortunately, we can’t use MRI to tell us how much energy our brain uses for different mental activities.

So, how much does brain activity increase?

    • MRI studies have shown attentively monitoring moving objects compared to passively watching them increases brain activity in our visual cortex by around 1%.
    • But interestingly, processing visual information leads to a reduction of activity in auditory areas, meaning we spend less energy processing the sounds in our environment.
    • This works the other way around as well: when we attend to auditory information, we reduce our visual processing activity.

Then why do we feel exhausted after too much mental activity?

    • Complex mental tasks are typically also emotionally challenging and lead to increased activation of our sympathetic nervous system, ultimately leading to mental and physical fatigue.
    • The good news is we don’t have to worry that too much mental activity will drain our brain energy.

O'Shaughnessy Ventures Awards Its Fifth $100,000 Fellowship Grant

Retrieved on: 
Friday, April 14, 2023

GREENWICH, Conn., April 14, 2023 /PRNewswire/ -- O'Shaughnessy Ventures LLC ("OSV"), an investment firm that empowers creators, has announced that it has awarded an O'Shaughnessy Fellowship to Mykhailo Marynenko. Marynenko is a software and hardware engineer from Ukraine. As well as being a keen researcher of security issues, he is passionate about building modern, collaborative, performant, scalable applications.

Key Points: 
  • Mykhailo Marynenko will use the $100,000 O'Shaughnessy Fellowship grant to fund various projects that combine technology, art, and human interaction.
  • GREENWICH, Conn., April 14, 2023 /PRNewswire/ -- O'Shaughnessy Ventures LLC ("OSV"), an investment firm that empowers creators, has announced that it has awarded an O'Shaughnessy Fellowship to Mykhailo Marynenko.
  • Marynenko will use his fellowship grant to work on projects that combine technology, art, and human interaction.
  • We are excited to see what unique technologies he builds during his O'Shaughnessy Fellowship."

Clene Reports Full Year 2022 Financial Results and Recent Operating Highlights

Retrieved on: 
Monday, March 13, 2023

The initial placebo-controlled double-blinded Phase 2 RESCUE-ALS results were strengthened further with evidence of a survival benefit and preserved function at one year and beyond.

Key Points: 
  • The initial placebo-controlled double-blinded Phase 2 RESCUE-ALS results were strengthened further with evidence of a survival benefit and preserved function at one year and beyond.
  • In December 2022, Clene closed a debt facility with the Maryland Department of Housing and Community Development to borrow $5.0 million.
  • On March 3, 2023, Clene entered into common stock purchase agreement for up to $25.0 million with Lincoln Park Capital Fund, LLC.
  • Clene expects that its resources as of December 31, 2022, will be sufficient to fund its operations into the third quarter of 2023.

Clene Announces Updated VISIONARY-MS Phase 2 Trial Data Presented at 2023 ACTRIMS Forum Show CNM-Au8® Demonstrated Significant Improvements in Clinical Outcomes, Brain Structure, and Visual System

Retrieved on: 
Monday, February 27, 2023

The poster titled, “CNM-Au8 Phase 2 VISIONARY-MS Updated Trial Results,” contributes to the growing body of evidence supporting improvements in clinical neurologic function and significant paraclinical MRI and VEP findings.

Key Points: 
  • The poster titled, “CNM-Au8 Phase 2 VISIONARY-MS Updated Trial Results,” contributes to the growing body of evidence supporting improvements in clinical neurologic function and significant paraclinical MRI and VEP findings.
  • The VEP and MRI analyses presented were prespecified exploratory endpoints.
  • The updated multi-focal Visual Evoked Potential (mf-VEP) findings provide evidence of improved information transmission in the visual system (from the eye to the visual cortex) supported by statistically significant increases in amplitude.
  • These data help build a strong case in favor of pursuing CNM-Au8 in further Phase 3 studies.”

ZEISS Microscopy's New Microsite Teases Content in Interactive Display Wall at SfN Neuroscience 2022 Conference

Retrieved on: 
Wednesday, November 2, 2022

WHITE PLAINS, N.Y. , Nov. 2, 2022 /PRNewswire/ -- The newly announced microsite from ZEISS Microscopy, gives visitors a glimpse of what they can interact with at SfN Neuroscience 2022, in San Diego, CA, booth 2228, from November 13 through November 16. The microsite showcases 9 researchers and their breakthroughs, some of whom will be featured in high visual detail on the booth's interactive touch screen.

Key Points: 
  • WHITE PLAINS, N.Y., Nov. 2, 2022 /PRNewswire/ -- The newly announced microsite from ZEISS Microscopy, gives visitors a glimpse of what they can interact with at SfN Neuroscience 2022, in San Diego, CA, booth 2228, from November 13 through November 16.
  • The microsite showcases 9 researchers and their breakthroughs, some of whom will be featured in high visual detail on the booth's interactive touch screen.
  • An example of neuroscience specific research presented on the interactive display at the ZEISS booth comes from Dr. Mclean Bolton , Research Group Leader at Bolton Lab.
  • Neuroscientists, and others interested in this research, can learn about Dr. Bolton's Brain Circuitry and Autism research , on the microsite, ahead of the conference.