sawyer🔸

Operations Director @ Tarbell Center for AI Journalism
1374 karmaJoined Working (6-15 years)New York, NY, USA
sawyerbernath.com/

Bio

Participation
3

Formerly Executive Director at BERI; now Secretary and board member. Current board member at SecureBio and FAR.AI, where I'm also the Treasurer.

Comments
95

Topic contributions
1

Ah! Yes that's a good point and I misinterpreted.That's part of what I meant by "historical accident" but now I think that it was confusing to say "accident" and I should have said something like "hisotrical activities".

I agree that they're worth calling out somehow, I just think "lab" is a misleading way to doing so given their current activities. I've made some admittedly-clunky suggestions in other threads here.

I completely agree that OpenAI and Deepmind started out as labs and are no longer so.

I agree that those companies are worth distinguishing. I just think calling them "labs" is a confusing way to do so. If the purpose was only to distinguish them from other AI companies, you could call them "AI bananas" and it would be just as useful. But "AI bananas" is unhelpful and confusing. I think "AI labs" is the same (to a lesser but still important degree).

I think this is a useful distinction, thanks for raising it. I support terms like, "frontier AI company," "company making frontier AI," and "company making foundation models," all of which help distinguish OpenAI from Palantir. Also it seems pretty likely that within a few years, most companies will be AI companies!? So we'll need new terms. I just don't want that term to be "lab".

Another thing you might be alluding to is that "lab" is less problematic when talking to people within the AI safety community, and more problematic the further out you go. I think that, within a community, the terms of art sort of lose their generic connotations over time, as community members build a dense web of new connotations specific to that meaning. I regret to admit that I'm at the point where the word "lab" without any qualifiers at all makes me think of OpenAI!

But code switching is hard, and if we use these terms internally, we'll also use them externally. Also external people read things that were more intended for internal people, so the language leaks out.

Interesting point! I'd be OK with people calling them "evil mad scientist labs," but I still think the generic "lab" has more of a positive, harmless connotation than this negative one.

I'd also be more sympathetic to calling them "labs" if (1) we had actual regulations around them or (2) they were government projects. Biosafety and nuclear weapons labs have a healthy reputation for being dangerous and unfriendly, in a way "computer labs" do not. Also, private companies may have biosafety containment labs on premises, and the people working within them are labworkers/scientists, but we call the companies pharmaceutical companies (or "Big Pharma"), not "frontier medicine labs".

Also also if any startup tried to make a nuclear weapons lab they would be shut down immediately and all the founders would be arrested. [citation needed]

From everything I've seen, GWWC has totally transformed under your leadership. And I think this transformation has been one of the best things that's happened in EA during that time. I'm so thankful for everything you've done for this important organization.

Yep! Something like this is probably unavoidable, and it's what all of my examples below do (BERI, ACE, and MIRI).

There are many examples of organizations with high funding transparency, including BERI (which I run), ACE, and MIRI (transparency page and top contributors page).

(Not deeply thought through) Funders have a strong (though usually indirect) influence on the priorities and goals of the organization. Transparency about funders adds transparency about the priorities and goals of the organization. Conversely, lack of funder transparency creates the appearance that you're trying to hide something important about your goals and priorities. This sort of argument comes up a lot in US political funding, under the banners of "Citizens United", "SuperPACs", etc. I'm making a pretty similar argument to that one.

Underlying my feelings here is that I believe charities have an obligation to the public. The government is allowing people to donate their income to a charity, and then (if they donate enough) to not pay taxes on that income. That saves the donor ~30% of their income in taxes. I consider that 30% to be public money, i.e. money that would have otherwise gone to the government as taxes. So as a rule of thumb I try to think that ~30% of a US charity's obligations are to the public. The main way charities satisfy this obligation is by sticking to their IRS-approved exempt purpose and following all the rules of 501(c)(3)s. But another way charities can satisfy that obligation is by being really transparent about what they're doing and where their money comes from.

Load more