Gating
AI we always wanted
AI we always wanted
Here, neural networks rely on carry-over gates, which rewire the network for the subsequent inputs. With gates, artificial neural networks can be shallow. The networks grow laterally, not vertically. These networks can generate outputs only if a correct set of gates is activated. (*Patent pending)
Gating is an invention based on insights on how human brain achieves intelligence. In the picture: metabotropic receptors and G protein-gated ion channels gate information flow in human brain.
This drawing is from our provisional patent. Those who know how deep learning works will probably understand that this is something completely different, something They've never seen before. This is a revolutionary new way of making machines intelligent.
What we see are two key novelties. One is that the network is shallow, not deep. It expands laterally but not vertically. The second and most revolutionary novelty is that the network has gates that can open and close pathways, transiently re-wiring the network. The network inputs open and close gates, the network gets re-wired, and then a network has a new look on the inputs. After that, more gates are opened and closed, and the network again gets re-wired and has a new look into the input. And this repeats ad infinitum. The loop of re-wiring through gates and taking new looks never stops.
The organisation into Action and Gating regions is a gist of how our brain works, whereby a similar loop brings about the never-ending flow of our consciousness. Our cerebral cortex is the equivalent of a hugely expanded gating region (16 billion neurons to be precise, organized into 52 Brodmann areas).
Gating is how AI will be working soon. We are about to replace deep learning with something much better, much more similar to how real brains work, something that can become conscious through the power of look-gate-rewire-look-again loop.
AI we always wanted.
A talk given at Pioneer Spotlight
We strive to develop AI products based on new machine learning technology — Gating — which solves many of the limitations of deep learning.
So far, AI technology had two generations. The first generation was Symbolic AI also known as GOFAI. Symbolic AI dominated AI until mid 1990s. After that the second generation took over dominated by deep learning. Gating makes such a big leap forward that it makes a new, third generation of AI. This generation may be describe as Strong AI. Among others, gating solves these problems of deep learning:
Please reach us at danko@gating.ai if you cannot find an answer to your question.
There are probably countless many use cases. These include the use cases to which we would like to apply large language models but cannot due to their limitations. Other use cases include computer vision and autonomous driving. Home robotic will be a great use case too.
Yes. Substantial resources are needed to build first AI products. Nevertheless, although substantial, these resources are orders of magnitude smaller than the resources needed to invest in deep learning to achieve a comparable level of intelligence.
No, the two are not related. Dropout takes place during training. Gates act during inference. Dropout randomly selects who will be dropped out. Gates are triggered by detected patterns and this association pattern-to-gate is meticulously learned.
No. Gating relies on learning mechanisms other then gradient descent.
The iterative activation of gates is not directly related to the growing networks problem. However, the process of learning gates is a related problem.
RNNs keep outputs of neurons for later and feed them as future inputs to neurons. In contrast, Gating holds information over time in the states of gates.
Yes. The first implementation is available here.
The learning process of a gated neural networks is more elaborate than that of deep learning. In addition to connections, also the properties of gates need to be adjusted during learning. In addition, the architecture of gated networks keeps expanding.
Training of gated networks requires AI-Kindergarten, which is an entire 'factory' for accumulation of knowledge. This includes learning curricula and many other components. Details of how AI-Kindergarten works are described in this document.
The theory behind Gating and AI-Kindergarten is called practopoiesis.
Gating is a result of several decades of scientific work. Here are some key scientific publications that led to Gating technology.
I have the pleasure of working with Danko on bunton projects, and I can confidently say that his mastery of AI and his entrepreneurial vision are unmatched. Danko is someone who not only understands the technical intricacies of AI but also has the rare ability to translate this knowledge into innovative, real-world solutions. His skil
I have the pleasure of working with Danko on bunton projects, and I can confidently say that his mastery of AI and his entrepreneurial vision are unmatched. Danko is someone who not only understands the technical intricacies of AI but also has the rare ability to translate this knowledge into innovative, real-world solutions. His skills are exceptional, driving success through a deep understanding of both technology and business. I highly recommend him as a true visionary in the field of AI and entrepreneurship.
I am confident that Danko is among the rare individuals capable of propelling humanity forward through AI. Achieving such a feat requires a profound understanding of AI and a keen sense of entrepreneurship—Danko embodies both.
My association with Danko began when he led AI development at a startup I invested in wherein, the startup quickly
I am confident that Danko is among the rare individuals capable of propelling humanity forward through AI. Achieving such a feat requires a profound understanding of AI and a keen sense of entrepreneurship—Danko embodies both.
My association with Danko began when he led AI development at a startup I invested in wherein, the startup quickly developed the leading AI solution for their use case, outperforming even established global corporations.
So, I was not surprised when Danko later unveiled his groundbreaking invention, Gating.
Working with Danko on various AI applications and assisting him in transforming his invention into a business has been a privilege.
Personally I like his positive attitude, integrity and professionalism as a wonderful team player.
A groundbreaking paradigm, Gating has the potential to revolutionize the field of artificial intelligence to an extent that hasn't been witnessed since the popularization of deep learning in 2012. With a strong theoretical foundation inspired by insight from rigorous neuroscience research, it holds the promise to address one of the most p
A groundbreaking paradigm, Gating has the potential to revolutionize the field of artificial intelligence to an extent that hasn't been witnessed since the popularization of deep learning in 2012. With a strong theoretical foundation inspired by insight from rigorous neuroscience research, it holds the promise to address one of the most pertinent challenges in modern AI: the challenge of creating a system capable of efficient and dynamic scaling to the complexity of the problem. By transferring the concept of "depth" in "deep learning" to the temporal axis, as in biological brains, Gating could allow for a level of generalizable learning yet to be imaginable for AI and could be a huge stride toward artificial general intelligence. I have always been mind-blown by the innovative originality of Danko's ideas and admired his courage to explore entirely novel paths in fundamental AI research, unafraid to build from the ground up if it meant making a game-changing development. Not only that, he has the ambition and leadership necessary to bring his idea into reality and introduce it to the world to transform others' work. His strong entrepreneurship as CEO of Robots Go Mental and his ability to clearly and enthusiastically illustrate his invention had led to my group at NASA Ames adapting Guided Transfer Learning, and I'm excited for the day that Gating comes to life and starts impacting projects around the world as well.
Gating will certainly leverage one of the most intriguing emerging
technologies with capabilities to imitate the human mind. I know Danko since over 20 years, both as a scientist and as an entrepreneur. He excels at both! His new technology is grounded in decades of intensive neuroscience research and reflects his relentless search for th
Gating will certainly leverage one of the most intriguing emerging
technologies with capabilities to imitate the human mind. I know Danko since over 20 years, both as a scientist and as an entrepreneur. He excels at both! His new technology is grounded in decades of intensive neuroscience research and reflects his relentless search for the neuronal mechanisms that support perception, cognition, and behavior. Gating is the result of Danko's incredible insights! I am sure it will usher a radically new and disruptive direction in AI. I very much look forward to see how this transformative technology will come to fruition in the next years.
I am excited about the Gating concept, which offers a transformative approach to AI learning—one that aligns more closely with the mechanisms of the human brain. Unlike traditional deep learning, this model promises learning from minimal data, pushing us towards the realm of a true one-shot learning. This is crucial, as it would allow AI
I am excited about the Gating concept, which offers a transformative approach to AI learning—one that aligns more closely with the mechanisms of the human brain. Unlike traditional deep learning, this model promises learning from minimal data, pushing us towards the realm of a true one-shot learning. This is crucial, as it would allow AI to adapt quickly and efficiently with limited computational resources, reflecting one of the ways we naturally learn from experience.
Moreover, the curriculum learning aspect brings a structured, progressive path to knowledge acquisition. Instead of being overwhelmed by vast, bulky datasets, this model promises to learn in stages, building upon previous experiences, making learning not only faster but more robust and meaningful. I believe this approach could be particularly powerful for AI systems that need to adapt continuously in dynamic environments, where real-time, incremental learning is essential.
Together, these attributes—learning with limited data and building upon a strong curriculum—I believe represent a significant leap forward for AI, enabling smarter, more adaptive, and more efficient systems.
I had the privilege of working closely with Danko Nikolic during his time as Head of AI and Data Science at our former company, evocenta. As the CEO of evocenta, I observed firsthand Danko’s remarkable technical expertise, leadership abilities, and entrepreneurial spirit.
Danko’s knowledge in AI and data science is truly exceptional. At ev
I had the privilege of working closely with Danko Nikolic during his time as Head of AI and Data Science at our former company, evocenta. As the CEO of evocenta, I observed firsthand Danko’s remarkable technical expertise, leadership abilities, and entrepreneurial spirit.
Danko’s knowledge in AI and data science is truly exceptional. At evocenta, he skillfully harnessed large language models to propel significant advancements in our projects, showcasing his deep understanding of complex algorithms and innovative problem-solving techniques. His talent for turning intricate technical concepts into practical, actionable strategies set new benchmarks for our team's success.
Beyond his technical prowess, Danko is a natural leader. He built our AI and Data Science team from scratch, bringing in top talent and cultivating a collaborative, high-performance environment. His leadership style is rooted in empathy, clear communication, and an unwavering commitment to excellence, which inspired the team to consistently deliver outstanding results.
Danko’s entrepreneurial mindset is another of his great strengths. He invented Guided Transfer Learning, a pioneering approach that greatly improves the efficiency and accuracy of machine learning models. This innovation led to the founding of a successful startup, Robots Go Mental, which has achieved significant milestones, including a collaboration with NASA to tackle complex real-world challenges.
Our professional journey continues today as we co-founded TreviAI, where Danko serves as Co-Founder and Chief Innovation and AI Officer (CIAO). His role is pivotal, leveraging his vast skill set and innovative technology stack to guide the company's vision and growth.
I am certain that Danko will bring the same level of dedication, creativity, and leadership to Gating. His combination of technical mastery, team-building skills, and entrepreneurial drive makes him exceptionally well-suited to lead Gating to new heights. I fully endorse Danko Nikolic and have every confidence that he will excel in his new venture.
We would love to hear from you.
Sachsenhäuser Landwehrweg 96, Frankfurt am Main 6059, Germany
Sign up to hear from us about our progress. Now available: GitHub repository.