Category Archives: science life

Rise of the Machines

Recently, there’s been a lot of interesting activity in the field generative AI for science from large companies such as Google, Meta and Microsoft.
Creating new materials from scratch is difficult, since materials involve complex interactions that are difficult to simulate, or a fair amount of luck in experiments (serendipity is scientists’s most terrifying friend)
Thus most of these efforts aim to discover new material by accelerating simulations using machine learning. But recent advances (such as LLM, e.g., ChatGPT) have shown that you can use AI to make coherent sentences instead of a word soup. But the same way cooking is not just about putting ingredient together all at once but carefully preparing them, making a new material involves important intermediate steps.  And new approaches can be used create new materials.

The various steps of making a new material (from Szymanski et al.)

Last month, Google in collaboration with Berkeley Lab announced that their DeepMind’s Gnome project had discovered a lot of new structures: Google DeepMind Adds Nearly 400,000 New Compounds to Berkeley Lab’s Materials Project. They managed to actually make and analyze some of those new materials ; that is quite a tour de force, and while there’s some interesting pushback on the claims, it’s still pretty cool!
In September, I invited Meta’s Open Catalyst at Berkeley Lab (here’s the event description and the recording – accessible to lab employees only)

Zachary Ulissi (Meta/OpenCatalyst) and Jin Qian (Berkley Lab) at Lawrence Berkeley National Laboratory (September 2023)

Meanwhile, Microsoft is collaborating with Pacific Northwest National Laboratory on similar topics
Meanwhile, the research infrastructure has it gears moving; it seems that DeepMind’s AlphaFold is already routinely used at the lab to dream up new protein structures. I wonder where this will go!
Prediction is very difficult, especially if it’s about the future
– Niels Bohr
Thinkpieces blending chips and AI in full bloom:
We need a moonshot for computing – Brady Helwig and PJ Maykish,  Technology Review

The Shadow of Bell Labs

I want to resurface an interesting thread by my former colleague Ilan Gur:

Continue reading

Hotline bling

I was lucky to meet the President of the University of California Michael V. Drake, in my capacity of co-chair of the Berkeley Lab Global Employee Resource group (global.lbl.gov), dedicated to providing support to international employees at the national laboratory.

Berkeley Lab Employee Resource Groups meeting with UC president Michael Drake in November 2023

I made the point the re-building communities should be a priority after the pandemic, and particularly early career scientists, who do not have family or go to school where they could thread their social fabric. The participation of international scientist at Berkeley Lab is an important strength, because the national lab is de facto at the center of international research, and that gives it a competitive edge compared to other countries such as China or Saudi Arabia, where large research expenditure cannot compensate the lack of free flow of ideas.

I think my talking points were well received, and president Drake encouraged collaboration on these topics with the University of California, Berkeley

On Mentorship

This last month, I received two awards related to mentorship from Berkeley Lab. They both came as a surprise, since I consider myself more a student of mentorship than someone who has something to show for.

Berkeley Lab Outstanding Mentorship Award

Director’s award for For building the critical foundations of a complex mentoring ecosystem

I began to be interested in mentorship after I realized that mentorship plays a large role in the success of young scientist, (1) having experience myself the difference between having no mentorship and having appropriate mentorship (I’ll be forever grateful to my mentor/colleague/supervisor Ken Goldberg), (2) having had tepid internship supervision experience due to the lack of guidance, (3) realizing that academia is ill-equipped to provide the resources necessary for success.

While I was running Berkeley Lab Series X, I always asked the speakers (typically Nobel prize laureates, stellar scientists and directors of prominent research institutions) how they learned to manage a group, and they answer was generally: “on the spot, via trial and error”, what struck me as awfully wrong. If people don’t get the proper resources/training, many are likely to fail, and drag their own group down the abyss. In this post, I will try to share resources I gathered along the years, and what I learned about mentorship, and provide some resources I found useful. This is more descriptive of my experience than prescriptive, but I hope you find this useful.

Continue reading

Updates on AI for big science

There’s a lot of things happening on the front of AI for Big Science (AI for large scale facilities, such as synchrotrons.)

The recently published DOE report in AI for Science, Energy, and Security Report provides interesting insights, and a much-needed update to the AI for Science Report of 2020.

Computing Facilities are upgrading to provide scientists the tools to engage with the latest advances in machine learning. I recently visited NERSC’s Perlmutter supercomputer, and it is LOADED with GPU for AI training.

A rack of Tesla A100 from the Perlmutter supercomputer at NERSC/Berkeley Lab

Meanwhile, companies with large computing capabilities are making interesting forays in using AI for science, for instance Meta, which is developing OpenCatalyst in collaboration with Carnegie-Mellon University, where the goal is to create AI models to speed up the study of catalysts, which are generally very computer-intensive (see the Berkeley Lab Materials Project.) Now the cool part is to verify these results using x-ray diffraction at a synchrotron facilities. Something a little similar happened with AlphaFold where newly derived structure may need to be tested with x-rays at the Advanced Light Source: Deep-Learning AI Program Accurately Predicts Key Rotavirus Protein Fold (ALS News)

Continue reading

Out Of Many

Last week I was lucky to meet with Vanessa Chan, the Chief Commercialization Officer for the Department of Energy and Director of the Office of Technology Transitions. She wanted to hear what kind of hurdles when it comes to start a company (hint: a lot.) I told her that a major, overlooked issue is that you generally to be a permanent resident to start at company in the US, whereas two-thirds of postdocs are foreign nationals and on visas. There are ways to get around the requirement (such as Unshackled), but it’s a little sad not more is done to provide support to those willing and able (plus – it is a well-known trope that many US companies are founded by foreign nationals, what I tend to believe is among what sets California apart from other states and other countries, where entrepreneurship doesn’t flourish as much as expected despite many efforts)

Conversation with Vanessa Chan

Resources on writing and presenting

Scientist lean many things while they study their subject, but never formally learn how to make a good presentation. Here’s a few resources that can be helpful to get started.

Making a presentation to an audience is important to get your ideas through, and while communication is a basic human trait, communicating effectively requires some thoughts (TED talk speakers go through a thorough training to get their point across.)

Don’t trust Tufte, go for gold

Someone who has a good resource is Jean-luc Doumont – he’s a regular speaker at the lab and Stanford, and a contributor to Nature and other publications. Here’s a few resources available online: https://www.principiae.be/X0302.php
(maybe this video at 1.5x speed is a good start: https://www.youtube.com/watch?v=meBXuTIPJQk)
Another interesting speaker is Peter Fiske, who also made a few presentations at the lab; I’m enclosing his slides from some time ago (another interesting but unrelated talk by him is
Careers In Physics Workshop: Putting Your Science to WORK, about career perspectives, networking etc.)
In general, the workshops for postdocs are really good, and should be attended:

Here are a few things learned, for the use of postdocs where one can easily drown everyone else. These are based on my experience, but there are many resources around the web to draw from.

Some practical presentation rules 

(These are stretch goals; I rarely follow these rules myself, but they are useful if you don’t know where to start.)

Use 16:9 format (these days most presentations are online, and most screen are wide)

Start with an outline.

Often, using the title to summarize the main point of the slide is a good use of the title.

No text should be smaller than 18pts.

Use animations sparingly, to expose your thoughts point by point. Avoid fancy animation or transition between slides

No more than one slide per minute (if there’s more, you can probably merge a few points)

Continue reading

In one FEL swoop

“I suppose in about fortnight we shall be told that he has been seen in San Francisco. It is an odd thing, but everyone who disappears is said to be seen at San Francisco. It must be a delightful city, and possess all the attractions of the next world.”
― Oscar Wilde, The Picture of Dorian Gray.

Lately, many of my colleagues have been leaving DOE light sources (Berkeley Lab and SLAC National Lab) to work for startup companies, and it seems that they all try to build better sources (probably based on Free Electron Lasers.)

Such companies are Tau Systems, xLight and a third one which seems to be stealth but looks light a giant black hole, given the pool of talent it managed to attract.

Good EUV sources have always been a problem, and the current solution using laser pulsed plasma, blasting 40kW of CO2 laser power onto 100um tin beads at khz rates to generate ~200W of EUV is totally crazy, but it works. Still, there must be better ways to do it, and given the unit cost of a EUV litho scanner ($200M), improving the uptime and productivity even by a few percent would be extremely valuable…

I’m wishing good luck to my colleagues going his route, this is quite exciting!

SFMOMA x Berkeley Lab: Hybrid forms

Yesterday I invited Tanya Zimbardo from the San Francisco Museum of Modern Art to give a talk at Berkeley Lab (details about the even can be found here: Hybrid Forms: Connecting Art and Science)

Tanya Zimbardo (SFMONA) at Berkeley Lab

It was quite interesting to hear her perspective on a topic which is close to my heart, and happy to hear many references to Rafael Lozano-Hemmer, who currently has the Techs-Mechs exhibition running at the Gray Area, but also quite surprising not hear anything about Jim Campbell (whose art glows atop the Salesforce building “Eye of Sauron”) or the work of Illuminate.

Continue reading

SMART & TGROW

Acronyms, I like acronyms!

Here are two resources that I found useful for (1) supervising researchers (SMART) and (2) mentoring scientists (TGROW)

SMART

(this is an excerpt from the Virtual Remote Mentor Guide -DOE-SC-WDTS Programs)
SMART is an acronym for a framework to help guide goal setting. It is intended to ensure that goals are planned, clear, trackable, and reachable. With SMART goals, you are more likely to achieve the goal efficiently and effectively. Below is an overview of the framework to establish SMART goals.

Continue reading

1000 days

Today is the thousandth day since the start of the pandemic, and we still haven’t figured out how to hold efficient meetings online.Here’s a useful resource:

A practical guide to Remote & Hybrid Communications – Berkeley Executive Education
https://drive.google.com/file/d/14ztjFkkKQGHK-HOtebUOtu-Lpa3DanVt/view

Continue reading