Words matter. These are the best Jeff Dean Quotes, and they’re great for sharing with your friends.
We have a lot of work to do to get really important useful capabilities into people’s hands – self-driving cars are going to save an enormous number of lives.
I am concerned in general about carbon emissions and machine learning.
Computers can see, and understand what people say via speech recognition.
I like working in small teams where people on the team have very different skills than what I have and that banter back and forth, and the ability to build something collectively that none of you could do individually is actually a really useful and valuable thing.
Definitely there’s growing use of machine learning across Google products, both data-center-based services, but also much more of our stuff is running on device on the phone.
It would be great to have every engineer have at least some amount of knowledge of machine learning.
The idea behind reinforcement learning is you don’t necessarily know the actions you might take, so you explore the sequence of actions you should take by taking one that you think is a good idea and then observing how the world reacts. Like in a board game where you can react to how your opponent plays.
As a society I think we are going to be much better off by having machines that can work in conjunction with humans to do things more efficiently and even better in some cases. That will ‘enable humans to do things that they do better than machines.
Some people are happy to work in a particular domain or some field of computer science for years, and years. I personally like to kind of move around every few years, just to learn about new areas.
You need to find someone that you’re gonna pair-program with who’s compatible with your way of thinking, so that the two of you together are a complementary force.
Microsoft is in a lot of the same businesses that Google is in.
Vision I think is going to be an important input. Like, if you’re using Google Glass, it’s going to be able to look around and read all the text on signs and do background lookups on additional information and serve that. That will be pretty exciting.
We have way more unsupervised data in the world than supervised data.
It’s nice to have short-term to medium-term things that we can apply and see real change in our products, but also have longer-term, five to 10 year goals that we’re working toward.
Some things are easier to parrellelize than others. It’s pretty easy to train up 100 models and pick the best one. If you want to train one big model but do it on hundreds of machines, that’s a lot harder to parallelize.
I tend to be very impatient, thinking about all the ways we can do something, my mind and hands spinning at a very fast rate.
Deep learning is a really powerful metaphor for learning about the world.
The things that I really enjoy doing are finding interesting problems and working together with colleagues to figure out how we can solve them.
Health care – the ability of neural networks to ingest lots of data and make predictions is very well suited to this area, and potentially will have a huge societal impact.
Very simple techniques, when you have a lot of data, work incredibly well.
One thing I think is true is that is you have someone who’s really good in one or a few areas they can pick up something new pretty quickly and that’s kind of a hallmark of someone you really want to hire because they can be very useful in a whole bunch of different areas.
Deep neural networks are responsible for some of the greatest advances in modern computer science.
I think true artificial general intelligence would be a system that is able to perform human-level reasoning, understanding, and accomplishing of complicated tasks.
If you pass a lot of data through a teeny network, like 20 neurons, it’ll do what it can, but it’s not going to be very good.
Reinforcement learning is the idea of being able to assign credit or blame to all the actions you took along the way while you were getting that reward signal.
I think multimodal kinds of models are pretty interesting – like can you combine text with imagery or audio or video in interesting ways?
I think robotics is a really hard problem – to make robots that operate in sort of arbitrary environments, like a big conference room with chairs and stuff.
I worry policymakers are not putting enough attention on what we should be planning for 10 years down the road. In general, governments aren’t necessarily that good at looking down the road when it is a difficult issue.
In Google data centers, our energy usage throughout the year for all our computing needs is 100 percent renewable.
With TensorFlow, when we started to develop it, we kind of looked at ourselves and said: ‘Hey, maybe we should open source this.’
I’ve always liked code that runs fast.
If you only have 10 examples of something, it’s going to be hard to make deep learning work. If you have 100,000 things you care about, records or whatever, that’s the kind of scale where you should really start thinking about these kinds of techniques.
Understanding language is core to a lot of Google products such as Gmail.
AI can help solve some of the most difficult social and environmental challenges in areas like healthcare, disaster prediction, environmental conservation, agriculture, or cultural preservation.
Supervised learning works so well when you have the right data set, but ultimately unsupervised learning is going to be a really important component in building really intelligent systems – if you look at how humans learn, it’s almost entirely unsupervised.
The healthcare space is a very complicated one for a variety of reasons: It’s much more regulated than some other kinds of industries, for good reason.
Previously, we might use machine learning in a few sub-components of a system. Now we actually use machine learning to replace entire sets of systems, rather than trying to make a better machine learning model for each of the pieces.
People in my organization were very outspoken about what we should be doing with the Department of Defense. One of them is work on autonomous weapons. That, to me, is something I don’t want to work on or have anything to do with.
In order to reason, you need a network to be able to bring in knowledge from several different areas, such as math, science, and philosophy, to reach reasonable conclusions on what it’s been tasked with.
I spend a fair amount of time dealing with email, mostly deleting them or skimming them to get a sense of what is going on.
I think one of the things about reinforcement learning is that it tends to require exploration. So using it in the context of physical systems is somewhat hard.
I think that is one of the main goals of pushing forward in machine learning: having computers provide the wisdom that a human companion would be able to provide in offering advice, looking up more information when necessary and those kinds of things.
Computers don’t usually have a sense of if you have a picture of something what is in that image. And if we can do a good job of understanding what is in an image, that can bring along a lot of new things you can do in applications.
Health care has a lot of interesting machine-learning problems – outpatient outcomes, or when you have x-ray images and you want to predict things.
It’s important to engage with governments around the world in how they’re thinking about AI – to help inform them.
