Neurocomputing Systems in the Metaverse. Present and Future.
#Doing
04.27.2023 Reading time: 10 minutes
Aitor Moreno Fernández de Leceta (Ibermática)
Illustration: Inge Borg
The history of Artificial Intelligence cannot be explained without neurocomputing1. The idea for the atomic neural network came out of a study by two Nobel Prize laureates on the squid giant axon, and the differentiable reduction of it marked the birth of Machine Learning systems.
THE INNOVATIVE SPIRAL
If we think about it, disruptive leaps in Artificial Intelligence have always had the same origin: the study of how our brain behaves at a physical and chemical level, and the modeling of this in digital systems. What a few years ago was very hard to implement (for example, computer vision models to identify objects in images, or natural language processing capable of extracting the intrinsic semantics from contexts) is currently within anyone’s reach – thanks, again, to the research by other Nobel Prize laureates.
When they investigated and identified how our visual cortex behaves, that was replicated in the form of convolutional networks and embeddings. Until then, all approaches to these problems were inefficient and unproductive. But this process is an innovative spiral. Thanks to thesebreakthroughs in Artificial Intelligence, advances in pattern-oriented modeling in complex systems allow neurocomputing research to be accelerated in such a way that Deep Learning models are making neurocomputing applications possible that had been unimaginable up until now.
MOVING THINGS WITHOUT MOVING
One of the areas that will generate the most business in the coming years is “Brain Computer Interface (BCI);” that is, interaction with digital systems (computers, machines, robots, drones, devices) through our thoughts. We already have an endless number of non-invasive devices (headbands similar to headphones) that are capable of recording the brain’s electromagnetic pulses (signals based on electroencephalography or EEG). From these signals (and with Artificial Intelligence) we are able to move a robot, manage a process, define gross motor movement in exoskeletons, and forget about keyboards, joysticks, and mice in simulation/virtual environments.
It is clear that immersive technologies like Virtual Reality have the potential to improve the remote operation of robots. Likewise, managing equipment and systems in the traditional way (either by keyboard or commands) is inefficient, since it distracts the technician from the problem to be solved, especially in critical environments. BCI technology, along with Virtual Reality, can take the operator to a virtual workspace where they are able to command the robots intuitively and directly (brain to machine) so that said learning can later be replicated in real environments.
EEG HEADSETS AND BCI SYSTEMS: IT’S THE THOUGHT THAT COUNTS
Recently, Ibermática in collaboration with the Universidad de Deusto and Virtualware has developed a VR system which allows for the training of industrial technicians together with robots in a VR environment through the use of EEG headsets. This, in turn, makes it possible for operators to have mental control of production equipment without the need for external control; only thoughts are needed. Meanwhile, operators can visually monitor the rest of the parts of the process. Clearly, in this context, major manufacturers like Meta, Intel, and Microsoft are already adding BCI systems to their video game platforms, in a revolution similar to the one pioneered in the past by the famous “Kinect.”
But the use of neurocomputing headsets does not only stop at controlling systems and virtual environments. Also (and this is a very mature and widespread application), using EEG signals from the brain, we can determine whether a user is liking what they’re seeing or not, if they’re comfortable in a virtual environment, if they’re stressed, apathetic, etc. We can even predict, based on different models, what the user’s reaction to specific environments will be.
Some of the most cutting-edge research is even making it possible to “translate” thoughts into images so that we can “see” what a user is thinking in real time. Clearly, this feature is worth its weight in gold in the metaverse. Knowing instantly if a user is attracted to a specific product, a specific logo, a specific environment, and/or a specific atmosphere, is the basis of a not-so-new advertising technique known as “neuromarketing.”
As an example, we recently published a study in which we can – through brain signals – know whether consumers really like new nutritional products in which sugar is replaced by other healthier components, simply by measuring their brain responses while they are trying them. The mind never lies. Customer satisfaction surveys do.
CUSTOM SYSTEMS TRAINING
There is still a problem to be solved, however: making models universal. Just like in the early days of speech-to-text transcription, when it was necessary to dedicate 20 minutes to training the Automatic Speech Recognition or ASR software in order for the machine to learn how we spoke (something totally outdated today with the current convolutional neural networks used by Siri, Alexa, and the transcription feature of our mobile phones), the same thing is happening with BCI systems. These systems, in order to be accurate, need a short bit of customized training for each user (15 minutes of adjustments). Like people’s voices, people’s brain patterns are unique and vary between individuals, with the difference that neural channels have a much more complex spectrum of frequencies, and this is a system that works in parallel on different channels (in different areas of the brain) at the same time and in an interconnected way.
There is an international race between companies to find a solution to this problem, given that the first to patent a working idea will have the exclusive rights over universal EEG modeling for virtual environments like the metaverse. The Ibermática Institute for Innovation (i3B) is working on two very promising lines of action. The first one, in which most of the current scientific and business community is involved, is to use highly advanced Artificial Intelligence techniques to come up with a mathematical model capable of modeling this complex network of signals, regardless of the user. That is, a model that allows for the generation of “embeddings” as if they were basic Lego pieces which, when put together, are able to reconstruct any EEG signal accurately, ignoring the particularities but maintaining the main idea of said signals (intentionality, thought, mobility, degree of attention, feelings, taste, etc..).
But there is another, much more tempting solution. It has been known for years now that neuronal behavior is not based only on classic mechanical behavior, but also on molecular behavior, depending on how the cell membranes of the neurons are affected by the sodium–potassium pump. There is a whole new discipline in Artificial Intelligence that is very promising in this regard, called neuromorphic computing, and the famous Spiking Neural Networks (SNNs).
But, if behavior is not purely classic, but based on the interaction of different particles, it seems sensible to think that a system that is able to accurately model the molecular behavior of said interactions, and extrapolate said behavior to the rest of the neurons in the different brain groups, would give us a solution not only to the problem of universality, but also to the challenge of building a very precise digital twin of the brain.
APPLICATIONS AND POTENTIAL
The applications of this probable solution would be multiple: we could simulate brain pathologies, like stroke and Alzheimer’s, and the evolution of brain tumors. And, of course, we could also simulate the behavior of our users in virtual environments like the metaverse. The technology that allows for this type of simulation at the quantum level in a natural, effective, and direct way does exist: quantum computing.
Until now it was not understood why the brain and its natural structures were able to process so much information in such a short time, despite having speeds much lower than that of current computer processors. The brain is completely parallel in nature, with a large number of processing elements (around 1,012 neurons) that are highly interconnected (up to 10,000 connections per neuron). Nevertheless, its processing time is slow, in the milliseconds. In addition, there are unicellular organisms (like the Protozoan Paramecium) that swim, find food, interact, learn, and remember without the need for any synapses. So, then, how is it possible that reasoning arises in such a short period of time? It has recently been discovered that, in addition to synapses and neuronal structures, there are structures called “microtubes,” which, apparently, regulate the cellular behavior of Protozoa, and even that of neuronal synapses. That is, each neuron contains a “microtubular” structure composed of “self-assembled” polymers based on the tubulin protein, forming cylinders with hexagonal lattices in which the paired filaments intersect in accordance with the Fibonacci sequence, in helical symmetry.
These structures turn into “molecular automata,” allowing signal oscillations in a range of 1,015 operations per second for each neuron, similar to the entire brain synapse – as well as a 15-qubit quantum computer.
Ibermática currently has access to quantum computers with more than 15 qubits, so they’re in a position to take on this strategy. In fact, Ibermática is fortunate to be collaborating with Enrique Solano, a pioneer in quantum computing, with whom the entity is beginning to connect EEG headsets to quantum computers with the aim of finding universal models and simulating brain behavior in a quantum environment at the molecular simulation level, and doing so in a direct way (it is always easier to simulate a quantum oscillation with a quantum particle than with a classical particle), also taking advantage of superposition (the volume of information to process) and quantum collapse (applying subjectivity to an environment with massive amounts of information). Fascinating.
A REALISTIC/FUTURISTIC PRESENT
In conclusion, there are cutting-edge and very powerful projects in neurocomputing that I recommend following, such as the European Human Brain Project, the Blue Project, and the European Brain Research Area. It is these initiatives that allow for advances in neuroscience that help us to understand the human brain, allowing these discoveries to be extrapolated towards new Artificial Intelligence models, which, in turn, in a constant spiral of innovation, are making possible the construction of, for the first time in history, more effective virtual patient systems (a clinical metaverse), as well as a deeper understanding of brain models.
This trio (neurocomputing, AI , and quantum science), together with new technologies, such as quantum computing, is accelerating clinical personalization processes and new computational interfaces that will be key in our daily lives in the coming years. The emulation of the brain in 3D simulation systems (both overall and at the molecular level), as well as simulation at the neuronal level, and iterations of it, are making it possible to diagnose and improve the treatment of certain pathologies, such as strokes, tumors, ALS, and Alzheimer’s, allowing us to evaluate and predict the evolution of said diseases at a personal level.
We might think that this is a futuristic technology, yet the current state of the art ranges from basic research to the sale of hardware systems with AI processes already built in. There is a real chance to lead a new era of advanced neurocomputing, which, in turn, will give rise to new Artificial Intelligence models based on neurocomputational study of the brain. Thus, we will have an opportunity to generate a new industry around quantum BCI systems. The global market for BCI systems was valued at $1.5 billion in 2021, and is expected to increase at a compound annual growth rate of 17.16% over the next several years. This is a unique national opportunity to lead a new industry that is promising worldwide, while not missing the chance to promote this field’s strong presence in industry and on the market.
For this, different multidisciplinary talents must come together, such as data scientists, scientists in engineering and quantum computing, and experts in neuroscience. Moreover, governments, companies, universities, and technology centers should foster collaborative environments for projects and joint work at the national level. We are in time to lead this new digital revolution.
Labels
- #quantum
- #innovación
- #ciencia
- #computación
- #física
- #futuro
- #metaverso
Take our advice and check it out
Slide to show more
Cookies
We use proprietary and third-party cookies for technical, analytical and customisation purposes, such as choosing the language in which to display the website. For more information, please consult our cookies policy (Opens modal window).
Cookies policy
The website at https://www.bizkaia.eus (hereinafter, the Website) uses tools to track browsing activity on the website and the IP address of the service recipient for the purpose of improving and guaranteeing the provision of services or technical operation of the website, distinguishing you from other users and analysing your browsing habits.
This Cookies Policy seeks to inform you clearly and precisely about the operation and function of the cookies we use.
What are cookies and why do we use them?
A cookie is a file that is downloaded to your computer when accessing certain websites.
Cookies enable a website to, among other things, store and recover information about the browsing habits of a user or their device and, depending on the information contained and the way in which the same is used by the device, may be used to recognise the user.
Current law allows us to store cookies on your device if they are strictly necessary for operation of this website. However, we need permission for all other cookies.
Types of cookies based on the managing entity
Depending on who manages the computer or domain from where the cookies are sent and who processes the data obtained, a distinction can be made between the following types of cookies:
- Proprietary cookies: these are managed by the Provincial Council of Biscay.
-
Third-party cookies: these are managed by another entity, which processes the data obtained via the cookies.
This website may contain cookies belonging to the Basque Government, used for its own purposes and stored by domains other than those owned by the Bizkaia Provincial Council.
Types of cookies based on their purpose
- Technical cookies: these allow the user to browse a website, platform or application and to use the various options or services available, such as control data traffic and communication, identify the session, access restricted areas, request registration or participation in an event, use security elements while browsing, store content for video or audio playback, or share content via social media networks.
- Customisation cookies: these allow the user to access the service with some general characteristics predefined according to a series of criteria on the user’s device, such as the language, type of browser being used to access the service, regional configuration from where the service is accessed, etc.
- Analysis cookies: these allow the number of users to be counted and the browsing activity to be statistically measured and analysed for the purpose of improving the services made available. They may be proprietary or third-party cookies.
Duration of the cookies
- Session cookies: these collect and store data while the user is visiting a website.
- Persistent cookies: the data are stored on the device in an ongoing fashion and may be accessed and processed during a period defined by the cookie manager, which may range from a few minutes to several years.
Which cookies does this website use?
In each row you can find data relating to Technical cookies
| Name | Purpose | Duration | Owner |
|---|---|---|---|
| JSESSIONID | Session identifier | Session | Bizkaia Provincial Council |
| ASPSESSIONID | Session identifier | Session | Bizkaia Provincial Council |
| TS01 | Session identifier | Session | Bizkaia Provincial Council |
| LFR_SESSION_STATE | Session identifier | Session | Bizkaia Provincial Council |
| COOKIE_SUPPORT | Indicate whether the user has the cookie support activated | 1 year | Bizkaia Provincial Council |
| pc_tecnicas_bizkaia | Choose your preferences for acceptance of the block of technical cookies | 1 year | Bizkaia Provincial Council |
| pc_analitica_bizkaia | Choose your preferences for acceptance of the block of analytical cookies | 1 year | Bizkaia Provincial Council |
| pc_preferencias_bizkaia | Choose your preferences for acceptance/rejection of the block of preferential cookies | 1 year | Bizkaia Provincial Council |
| pc_terceros_bizkaia | Choose your preferences for acceptance/rejection of the block of third-party cookies | 1 year | Bizkaia Provincial Council |
| Kultursistema_session | Keeping the user’s session | 1 year | Kultursistema |
| CPLB | Contains information used by our load-balancing servers | Session | Provincial Council of Biscay |
| XSRF-TOKEN | To prevent CSRF (Cross-Site Request Forgery) attacks | 1 year | Kultursistema |
| _GRECAPTCHA | Protects the website from spam and brute-force attacks | 5 months |
In each row you can find data relating to Analysis cookies
| Name | Purpose | Duration | Owner | |
|---|---|---|---|---|
| dtCookie | Track a visit through multiple requests | Session | Bizkaia Provincial Council | |
| dtLatC | Measure the latency of the server to monitor performance | Session | Bizkaia Provincial Council | |
| dtPC | Necessary to identify the appropriate parameters for beacon transmission; includes session ID for correlation | Session | Bizkaia Provincial Council | |
| dtSa | Intermediate storage for actions spanning pages | Session | Bizkaia Provincial Council | |
| rxVisitor | Visitor ID to correlate sessions | Constantly | Bizkaia Provincial Council | |
| rxvt | Session waiting time | Session | Bizkaia Provincial Council | |
| iyrc-user-id | Distinguish users | 1 year | Bizkaia Provincial Council | |
| _ga, _ga_XXXXXXXXXXX | Analysis | To distinguish users | 2 years | Google Analytics |
| _gat, _gat_XXXXXXXXXXX | Analysis | To limit the percentage of requests | 1 minute | Google Analytics |
| _gid | Analysis | To distinguish users | 1 day | Google Analytics |
In each row you can find data relating to Personalisation cookies
| Name | Purpose | Duration | Owner |
|---|---|---|---|
| Idioma | Select the language preferred by the user | 1 year | Bizkaia Provincial Council |
| cookie-tramites-favs | Save favourite procedures in Prior Appointment | 1 year | Bizkaia Provincial Council |
In each row you can find data relating to Third-party cookies
| Name | Purpose | Duration | Owner |
|---|---|---|---|
| CLID | Identify a user’s first visit | 1 year | Microsoft Clarity |
| APISID | Store user preferences and information during page views with Google maps in them. | 2 years | |
| HSID | Store user preferences and information during page views with Google maps in them. | 2 years | |
| MUID | Store user preferences and information during page views with Google maps in them. | 1 year | Microsoft Clarity |
| NID | Remember their preferences and other information | 6 months | |
| SAPISID | Show personalised advertisements on Google sites | 2 years | |
| SID | Provide advertisement delivery or retargeting, provide fraud prevention. | 2 years | |
| SIDCC | Provide reliable web traffic identification. | 1 year | |
| SM | Used to synchronise the MUID between Microsoft domains. | Session | Microsoft Clarity |
| SSID | Provide advertisement delivery or retargeting, provide fraud prevention. | 2 years | |
| __Secure-1PAPISID | Create a website visitor interest profile to show relevant and personalised Google advertising. | 2 years | |
| __Secure-1PSID | Create a website visitor interest profile to show relevant and personalised Google advertising. | 2 years | |
| __Secure-1PSIDCC | Create a website visitor interest profile to show relevant and personalised advertising through retargeting. | 1 year | |
| __Secure-1PSIDTS | Create a website visitor interest profile to show relevant and personalised advertising through retargeting. | 1 year | |
| __Secure-3PSID | 2 years | ||
| __Secure-3PSIDCC | Create a website visitor interest profile to show relevant and personalised advertising through retargeting. | 1 year | |
| __Secure-3PSIDTS | Create a website visitor interest profile to show relevant and personalised advertising through retargeting. | 1 year | |
| __Secure-ENID | Necessary cookies to use website services and options | 1 year | |
| ar_debug | Refine advertisements. | 1 año | |
| MR | Indicate when MUID is refreshed | 6 months | Microsoft Clarity |
| XSRF-TOKEN | Indicate when MUID is refreshed | 1 hour | Kultursistema |
| _fbp | Store and track website visits | 1 year | |
| kultursistema_session | Keep the user’s session | 1 hour | Kultursistema |
| AEC | Detect spam, fraud, and abuse | 6 months | |
| SOCS | Store user cookies preferences | 13 months | |
| Locale | not available | Basque government | |
| _hegoa_coop_session | Create a session ID for users | Session | Basque government |
How to deactivate or delete cookies?
When first accessing the Website, the user may configure and accept or reject the cookies on this Website. Subsequently, the user may change or withdraw their consent at any time via this Cookies Policy or the settings page.
However, you may exercise your right to freely deactivate them and even delete the cookies on this Website at any time. This is done differently depending on which browser you are using. Here is a quick guide for the most popular browsers.
- Deactivate Cookies in Chrome
- Deactivate Cookies in Explorer
- Deactivate Cookies in Firefox
- Deactivate Cookies in Safari
- Deactivate Cookies in Edge
If you deactivate or delete cookies, certain features of the Website may no longer function correctly.
Changes to the Cookies Policy
The Website reserves the right to change this Cookies Policy under the terms provided for by current legislation. We therefore recommend that you revise this policy each time you access our website to see any changes and read the pertinent information.
Configure cookies
We show you hereinbelow the different categories of cookies that our web page uses. You can personalise your choice by accepting or rejecting these categories through the buttons enabled to that end. For more information, consult our cookies policy (Opens modal window).
-
Technical Always active
These are needed to allow browsing on our website and for basic tasks related to correct website operation.
