Category Archives: berkeley lab

Rise of the Machines

Recently, there’s been a lot of interesting activity in the field generative AI for science from large companies such as Google, Meta and Microsoft.
Creating new materials from scratch is difficult, since materials involve complex interactions that are difficult to simulate, or a fair amount of luck in experiments (serendipity is scientists’s most terrifying friend)
Thus most of these efforts aim to discover new material by accelerating simulations using machine learning. But recent advances (such as LLM, e.g., ChatGPT) have shown that you can use AI to make coherent sentences instead of a word soup. But the same way cooking is not just about putting ingredient together all at once but carefully preparing them, making a new material involves important intermediate steps.  And new approaches can be used create new materials.

The various steps of making a new material (from Szymanski et al.)

Last month, Google in collaboration with Berkeley Lab announced that their DeepMind’s Gnome project had discovered a lot of new structures: Google DeepMind Adds Nearly 400,000 New Compounds to Berkeley Lab’s Materials Project. They managed to actually make and analyze some of those new materials ; that is quite a tour de force, and while there’s some interesting pushback on the claims, it’s still pretty cool!
In September, I invited Meta’s Open Catalyst at Berkeley Lab (here’s the event description and the recording – accessible to lab employees only)

Zachary Ulissi (Meta/OpenCatalyst) and Jin Qian (Berkley Lab) at Lawrence Berkeley National Laboratory (September 2023)

Meanwhile, Microsoft is collaborating with Pacific Northwest National Laboratory on similar topics
Meanwhile, the research infrastructure has it gears moving; it seems that DeepMind’s AlphaFold is already routinely used at the lab to dream up new protein structures. I wonder where this will go!
Prediction is very difficult, especially if it’s about the future
– Niels Bohr
Thinkpieces blending chips and AI in full bloom:
We need a moonshot for computing – Brady Helwig and PJ Maykish,  Technology Review

The Shadow of Bell Labs

I want to resurface an interesting thread by my former colleague Ilan Gur:

Continue reading

Hotline bling

I was lucky to meet the President of the University of California Michael V. Drake, in my capacity of co-chair of the Berkeley Lab Global Employee Resource group (global.lbl.gov), dedicated to providing support to international employees at the national laboratory.

Berkeley Lab Employee Resource Groups meeting with UC president Michael Drake in November 2023

I made the point the re-building communities should be a priority after the pandemic, and particularly early career scientists, who do not have family or go to school where they could thread their social fabric. The participation of international scientist at Berkeley Lab is an important strength, because the national lab is de facto at the center of international research, and that gives it a competitive edge compared to other countries such as China or Saudi Arabia, where large research expenditure cannot compensate the lack of free flow of ideas.

I think my talking points were well received, and president Drake encouraged collaboration on these topics with the University of California, Berkeley

On Mentorship

This last month, I received two awards related to mentorship from Berkeley Lab. They both came as a surprise, since I consider myself more a student of mentorship than someone who has something to show for.

Berkeley Lab Outstanding Mentorship Award

Director’s award for For building the critical foundations of a complex mentoring ecosystem

I began to be interested in mentorship after I realized that mentorship plays a large role in the success of young scientist, (1) having experience myself the difference between having no mentorship and having appropriate mentorship (I’ll be forever grateful to my mentor/colleague/supervisor Ken Goldberg), (2) having had tepid internship supervision experience due to the lack of guidance, (3) realizing that academia is ill-equipped to provide the resources necessary for success.

While I was running Berkeley Lab Series X, I always asked the speakers (typically Nobel prize laureates, stellar scientists and directors of prominent research institutions) how they learned to manage a group, and they answer was generally: “on the spot, via trial and error”, what struck me as awfully wrong. If people don’t get the proper resources/training, many are likely to fail, and drag their own group down the abyss. In this post, I will try to share resources I gathered along the years, and what I learned about mentorship, and provide some resources I found useful. This is more descriptive of my experience than prescriptive, but I hope you find this useful.

Continue reading

Lamaseries

It’s been a few months since the ChatGPT craze started, and we’re finally seeing some interesting courses and guidelines, particularly for coding, where I found the whole thing quite impressive.

https://static.tvtropes.org/pmwiki/pub/images/llama_loogie_tintin.jpg

Ad hoc use of LLaMa

Here’s a few that can be of interest, potentially growing over time (this is mostly a notes to self.)

Plus – things are getting really crazy: Large language models encode clinical knowledge (Nature, Google Research.)

 

Updates on AI for big science

There’s a lot of things happening on the front of AI for Big Science (AI for large scale facilities, such as synchrotrons.)

The recently published DOE report in AI for Science, Energy, and Security Report provides interesting insights, and a much-needed update to the AI for Science Report of 2020.

Computing Facilities are upgrading to provide scientists the tools to engage with the latest advances in machine learning. I recently visited NERSC’s Perlmutter supercomputer, and it is LOADED with GPU for AI training.

A rack of Tesla A100 from the Perlmutter supercomputer at NERSC/Berkeley Lab

Meanwhile, companies with large computing capabilities are making interesting forays in using AI for science, for instance Meta, which is developing OpenCatalyst in collaboration with Carnegie-Mellon University, where the goal is to create AI models to speed up the study of catalysts, which are generally very computer-intensive (see the Berkeley Lab Materials Project.) Now the cool part is to verify these results using x-ray diffraction at a synchrotron facilities. Something a little similar happened with AlphaFold where newly derived structure may need to be tested with x-rays at the Advanced Light Source: Deep-Learning AI Program Accurately Predicts Key Rotavirus Protein Fold (ALS News)

Continue reading

Institutional Open Data

Things are moving in terms of Open Data! The Department of Energy has just released an update to it Public Access Plan (initially published in 2014), and embracing the use of persistent identifiers for papers and data, to promote the FAIR principles (Findability, Accessibility, Interoperability, and Reusability of data and metadata.)

Mariposa Lillies, from Alexis Madrigal of the Oakland Garden Club

And let me insist on the last bit:

Data without metadata is mostly useless

At the time where Twitter was a nice place to share thoughts and disseminate bite-sized knowledge, I thought the Twitter posts/URL were something akin to Digital Object Identifiers – you could post an image with caption, and share the link on your blog or with anyone (now Twitter doesn’t allow to share those so easily.) Zenodo allows you to creat actual DOI for your data (data will include your ORCID and metadata.), albeit not as user-friendly – and to some extent, github works the same way (the visualization and graphical content is not the best)

At Berkeley Lab, the Office of Research Compliance has updated its guideline, providing excellent resources to build a Data Management Plan.

Out Of Many

Last week I was lucky to meet with Vanessa Chan, the Chief Commercialization Officer for the Department of Energy and Director of the Office of Technology Transitions. She wanted to hear what kind of hurdles when it comes to start a company (hint: a lot.) I told her that a major, overlooked issue is that you generally to be a permanent resident to start at company in the US, whereas two-thirds of postdocs are foreign nationals and on visas. There are ways to get around the requirement (such as Unshackled), but it’s a little sad not more is done to provide support to those willing and able (plus – it is a well-known trope that many US companies are founded by foreign nationals, what I tend to believe is among what sets California apart from other states and other countries, where entrepreneurship doesn’t flourish as much as expected despite many efforts)

Conversation with Vanessa Chan

SFMOMA x Berkeley Lab: Hybrid forms

Yesterday I invited Tanya Zimbardo from the San Francisco Museum of Modern Art to give a talk at Berkeley Lab (details about the even can be found here: Hybrid Forms: Connecting Art and Science)

Tanya Zimbardo (SFMONA) at Berkeley Lab

It was quite interesting to hear her perspective on a topic which is close to my heart, and happy to hear many references to Rafael Lozano-Hemmer, who currently has the Techs-Mechs exhibition running at the Gray Area, but also quite surprising not hear anything about Jim Campbell (whose art glows atop the Salesforce building “Eye of Sauron”) or the work of Illuminate.

Continue reading

SMART & TGROW

Acronyms, I like acronyms!

Here are two resources that I found useful for (1) supervising researchers (SMART) and (2) mentoring scientists (TGROW)

SMART

(this is an excerpt from the Virtual Remote Mentor Guide -DOE-SC-WDTS Programs)
SMART is an acronym for a framework to help guide goal setting. It is intended to ensure that goals are planned, clear, trackable, and reachable. With SMART goals, you are more likely to achieve the goal efficiently and effectively. Below is an overview of the framework to establish SMART goals.

Continue reading

1000 days

Today is the thousandth day since the start of the pandemic, and we still haven’t figured out how to hold efficient meetings online.Here’s a useful resource:

A practical guide to Remote & Hybrid Communications – Berkeley Executive Education
https://drive.google.com/file/d/14ztjFkkKQGHK-HOtebUOtu-Lpa3DanVt/view

Continue reading