Sakana AI raises $30M to develop small, collaborative AI models

AI SaaS

Sakana AI, an artificial intelligence startup based in Tokyo, Japan that takes inspiration from the way that animals such as fish and birds work together, today announced it has raised $30 million in seed funding to build smaller and more agile AI models.

The seed funding round was led by prominent venture capital firms Lux Capital and Khosla Ventures, both of which are well-known for their history of investments in the AI industry. The venture capital arms of telecom giants Nippon Telegraph and Telephone Corp. and KDDI Corp. as well as Sony Corp. also participated in the round.

Sakana’s name comes from the Japanese word for fish, and the company’s logo includes a group of black fish, including a red one swimming away. As other companies work on bigger and more complex large language models, the company has been operating on the idea that biomimicry, or looking at how groups of animals such as fish, bees, ants and birds collaborate can help make smaller models.

Launched in August, Skana is co-founded by Chief Executive David Ha, who previously held the position of head of research at Stability AI Ltd., the developer of the open-source Stability Diffusion image generation model. Ha also led Google LLC’s research group in Japan. Company co-founder Llion Jones co-authored the 2017 research paper entitled “Attention Is All You Need,” which laid the groundwork for generative AI models by introducing the architecture for transformers – which is the core component of large language models such as OpenAI’s ChatGPT chatbot.

Using what the company calls ideas from nature such as “collective intelligence” and evolution, it intends to engineer smaller AI models that can collaborate in a swarm. This is in contrast to the ever-increasing size of LLMs that have scaled up in complexity to overcome problems such as holding conversations, answering questions and summarizing documents.

In terms of natural intelligence, this would be similar to the way that an ant colony uses many individuals to approach a common goal. For example, they break up a large task amongst many smaller agents or actors so that it can be performed with greater efficiency and agility than a single large and cumbersome model.

“There is room to develop new approaches and ideas to AI,” Ha said in an interview with Nikkei Asia.

By headquartering in Tokyo, Ha added, Sakana can attract expertise from Japan’s pool of top AI talent and foster innovation in the region. The company would first focus on Asian markets and announced a research partnership with NTT in November. NTT intends to deploy a Japanese language LLM named “tsuzumi” in March and will work with Sakana on its development.

“Sakana AI being based in Japan with a first focus on Asian markets is unique and important,” said Josh Wolfe, co-founder and managing partner at Lux Capital. “In an increasingly complex world, Asia needs and will have an influential new AI trailblazer, and Japan, a powerful democratic nation and a great ally of the U.S., is poised to be that leader.”

Image: Sakana AI

Your vote of support is important to us and it helps us keep the content FREE.

One click below supports our mission to provide free, deep, and relevant content.  

Join our community on YouTube

Join the community that includes more than 15,000 #CubeAlumni experts, including Amazon.com CEO Andy Jassy, Dell Technologies founder and CEO Michael Dell, Intel CEO Pat Gelsinger, and many more luminaries and experts.

“TheCUBE is an important partner to the industry. You guys really are a part of our events and we really appreciate you coming and I know people appreciate the content you create as well” – Andy Jassy

THANK YOU

AI SaaS

Leave a Reply

Your email address will not be published. Required fields are marked *