In August 2023, as part of Mark Zuckerberg’s “Year of Efficiency” which culminated in more than 20,000 layoffs, Meta disbanded a research team of several scientists who had developed an AI pervasive language type for biology. Had experienced.
Thank you for reading this post, don't forget to subscribe!However Alexander Rives, who led the research team called Meta’s “AI Protein Team”, was not deterred by Meta’s visit. He immediately launched a startup with a core team of his former Meta colleagues, called EvolutionaryScale, to further their work building comprehensive language models that, instead of generating text, images or videos, Prepare recipes only for unused proteins.
The idea is to create truly programmable biology, with applications ranging from drug manufacturing and cancer treatments (the equivalent of antibodies) to environmental policy strategies (for example, enzymes – which are proteins – could help break down plastic). Up to 100,000 possible programs are included. Researchers will be able to specify the function and optional characteristics of a protein, such as its toxicity to humans, according to an instruction and the AI will send back the DNA components to produce that protein.
Recently, EvolutionaryScale, founded in New York and San Francisco, announced that it has raised more than $142 million in seed investment led by Nat Friedman and Daniel Improper, with participation from Amazon Internet Services and Products (AWS), EnVentures, and Lux Capital. Have collected. (Nvidia’s venture capital arm), and angel traders. The announcement adds Rives and his ex-Meta team to the growing list of META alumni – a sort of “Meta AI mafia” – that have made waves with untested startups in the field, most notably Mistral.
Along with the investment, the company also announced that it has created ESM3, which Rives explained Luck There is a generative type for biology that has been trained on more computation than any alternative LLM in that category. It has been trained on approximately 4 billion proteins from types, flora and fauna, as well as DNA sequence, physical structure and protein structure – 3 basic aspects of the biology and biochemistry of proteins. And in an unpublished paper, EvolutionaryScale confirmed a way to apply ESM3 to generate a completely uncharacterized fluorescent protein—a type of protein first isolated in sparkling jellyfish—that, in nature, is evolutionarily stable. Will develop over hundreds of thousands of years.
The AI variant, he explained, could process the three-dimensional structure of proteins as a language – in the form of an alphabet of different characters – which could then be brought to bear on other models, including ChatGPT. However in this case, the “grammar” of the protein allows the type to occur with any combination of protein sequence, structure, and function. “We see that the model is able to find very creative solutions to these signals,” he said.
Such large-scale training requires experience in both biology and instrument studies and enormous amounts of computing energy – and this is why the initial investment has increased tremendously. “Similar to other frontier modeling efforts in AI, they require a lot of computation to build and train,” Rives said. “Investment growth really reflects the resources we need to do this,” he said.
Evolutionaryscale is some distance away from a corporate homing in on generic AI-powered biology and even an opportunity to do an LLM specifically. InstaDeep, a London-based company acquired by BioNTech in 2023, best known for helping develop the Pfizer COVID vaccine, has created an LLM for genomics, albeit the only one as large as EvolutionaryScale Not there. , Profluent, a San Francisco-founded AI-enabled biotech startup, may be excited about creating an LLM to design untested proteins. And Google DeepMind’s AlphaFold is a variant that predicts the formation of proteins using a type of generative AI.
Friedman, who led the investment round in EvolutionaryScale with his investment partner Improper, said Rives and the other Meta alumni are a “dream team.” (Recently co-founded an unfunded startup, Barricade Superintelligence, with ex-OpenAI’s Ilya Sutskever and Daniel Levy.)
“This was clearly the team that invented protein language modeling and had all the potential to advance it,” Friedman said. “Alex thinks big. He wants to create a complete multimodal model that can capture all the complexities of biology. I was looking for someone who had the ambition, vision, scale of thinking and expertise to deliver it.”
Rives said ESM3 could have an immediate impact on clinical analysis, with teachers able to use different types of attentional changes. The company will also trade a business model for pharmaceutical companies for utility in drug discovery and manufacturing. This is related to the type that Google DeepMind has adopted, with a model from AlphaFold available separately to researchers, although a free spinout company, Isomorphic Labs, is pursuing partnerships with pharmaceutical companies.
As for Meta, Rives said he wasn’t too surprised when the company disbanded his team.
“Meta is not a biotechnology company,” he said. Life Meta’s attentional analysis tradition made it an “incredible” park to paint in, he added, adding, “We were getting to the point where we really wanted to go to the next level of scaling these models. “I think creating a new company was really the right place to do it.”
Friedman noted that this is an “incredibly talented alumni group that came out of the meta”. “They’ve hired some incredible people – and I think the EvolutionaryScale team is very grateful to Meta for spearheading their efforts.”
This post was published on 06/25/2024 3:00 am
Pro Football Hall of Famer Terrell Davis He has accused United Airlines of a "disgusting…
transparency market analysisThe adoption of regenerative dentistry ideas into preventive care methods revolutionizes the traditional…
The USA Basketball showcase continues this week with its second and final game in Abu…
The S&P 500 Index ($SPX) (SPY) is recently down -0.89%, the Dow Jones Industrials Index…
Emmy season is back, and Tony Hale ("Veep") and Sheryl Lee Ralph ("Abbott Elementary"), along…
Dublin, July 17, 2024 (GLOBE NEWSWIRE) -- The file "e-Prescription Systems - Global Strategic Business…