d

Experts explain approach to estimating foodborne diseases

Scientists have shared details of how they are going about updating foodborne infection figures that will be published by the World Health Organization (WHO) in 2025. As part of the process to update estimates on the burden of foodborne diseases published in 2015, WHO is conducting a global source attribution... Continue Reading



  • For Public Health Professionals
  • World
  • Foodborne Disease Burden Epidemiology Reference Group (FERG)
  • foodborne illness estimates
  • source attribution
  • World Health Organization (WHO)

d

CDC investigating 21 outbreaks

The Centers for Disease Control and Prevention typically coordinates between 17 and 36 investigations of foodborne illnesses involving multiple states each week.  A report is posted weekly, but does not include any information about where the outbreaks are occurring, what foods are involved, or how many patients have been identified.... Continue Reading




d

RFK Jr. and the Make America Healthy Again agenda could impact food safety

RFK Jr., a lawyer-politician, could replace lawyer-politician Xavier Becerra as Secretary of Health and Human  Services. Or RFK Jr could be the next Secretary of Agriculture, replacing  Tom Vilsack, a lawyer. Deputy FDA Commissioners are sometimes lawyers. Dr. Robert Califf, a cardiologist, is the outgoing FDA Commissioner. The fact that... Continue Reading




d

Large EU-wide Salmonella outbreak linked to tomatoes from Italy

A multi-country Salmonella outbreak in Europe linked to tomatoes from Italy has sickened more than 250 people. From January 2023 to November 2024, 266 confirmed cases of Salmonella Strathcona have been identified in 16 European countries and the United Kingdom. Croatia, Czech Republic, Denmark, Estonia, Finland, France, Ireland, Luxembourg, the... Continue Reading




d

South Africa investigates local shops as death toll passes 20

More than 20 people are believed to have died in one South African province after consuming food from local shops. Gauteng Premier Panyaza Lesufi said the majority of deaths have been children aged between six and nine. “The first uniform approach across the province was to adopt a mechanism of... Continue Reading




d

Battle of The Stuffing: Stove Top Versus Homemade

When it’s time to make stuffing, whether it’s for Thanksgiving or any other meal, you have a decision to make. Do you make homemade stuffing or go for the shortcut and buy Stove Top? It comes down to the ease of making something right out of a box versus the satisfaction of making the perfect […]




d

Donald Trump and Elon Musk: Could U.S. election's odd couple unleash a small-government revolution?

The appointment of a political outsider like Musk could help Trump cut regulations and rein in government bureaucracy, even if the moves are unpopular




d

Posthaste: These are the best buyers' markets in Canadian real estate — for now

Listings outpace demand in Toronto and Vancouver




d

Major labour shortage looms in Atlantic Canada as immigration cuts take hold

Atlantic Canadians say the region has room to grow, but is facing a shrinking labour pool




d

What a Trump presidency could mean for Canadian pocketbooks

Stock and bond markets are already reacting in anticipation of the changes




d

What is going on at AIMCo? Find out more at Q&A Wednesday

The surprise firings at Alberta Investment Management raises many questions. We will try to answer them




d

Labour minister moves to end port lockouts in Montreal and British Columbia

Dispute risks damage to Canada's reputation as reliable trade partner, says Steven Mackinnon




d

Will Canada Post deliver? A look inside the labour dispute, the stakes and what comes next

Canada Post workers might soon be putting down their mailbags and grabbing picket signs




d

Stephen Harper's name in mix as potential head of AIMCo, sources say

Sources say Harper’s name has been in the mix for at least 10 months




d

Over a dozen people rescued after wave throws boaters into Florida waters: authorities

Several people were rescued on Saturday after a wave damaged their vessel off the coast of Florida, sending some of the boaters into the water.



  • 152af265-4030-5ffb-92d1-95c5cc2e3a92
  • fnc
  • Fox News
  • fox-news/us/us-regions/southeast/florida
  • fox-news/us/crime/police-and-law-enforcement
  • fox-news/great-outdoors/boating
  • fox-news/us
  • article

d

Trump picks former intel director John Ratcliffe to head the CIA

John Ratcliffe, who previously served as President-elect Trump's principal intelligence advisor, has now been picked by Trump to serve as director of the CIA.



  • 7483051c-abdc-519c-8f6b-294dd3f54215
  • fnc
  • Fox News
  • fox-news/person/donald-trump
  • fox-news/politics/elections
  • fox-news/politics
  • fox-news/tech/topics/cia
  • fox-news/politics
  • article

d

Cowboys' Dak Prescott elects to have season-ending surgery to address injured hamstring, Jerry Jones says

The Dallas Cowboys quarterback got another opinion on his hamstring and decided that surgery would be the best way to address the injury.



  • f8d4b7f0-229c-5132-b195-d53df731c643
  • fnc
  • Fox News
  • fox-news/sports/nfl/dallas-cowboys
  • fox-news/sports/nfl
  • fox-news/person/dak-prescott
  • fox-news/sports
  • fox-news/health/medical-research/surgery
  • fox-news/sports
  • article

d

British woman busted at Los Angeles airport with meth-soaked T-shirts: police

Myah Saakwa-Mante, a 20-year-old British university student, was caught at Los Angeles International Airport and arrested after allegedly attempting to smuggle T-shirts soaked with methamphetamine.



  • 025772a1-a0d2-5169-b96e-07d8919e9f08
  • fnc
  • Fox News
  • fox-news/us/crime
  • fox-news/us/los-angeles
  • fox-news/travel/general/airports
  • fox-news/us/crime/drugs
  • fox-news/us
  • article

d

Betsy DeVos joins Trump’s call to 'disband' the Department of Education and 're-empower' families

Former Education Secretary Betsy DeVos discusses what a second Trump term could mean for U.S. education on "The Story with Martha MacCallum."



  • 2426f898-56cb-51b3-9650-47f0ef4cf50e
  • fnc
  • Fox News
  • fox-news/media
  • fox-news/topic/fox-news-flash
  • fox-news/us/education/dept-of-education
  • fox-news/politics/elections/presidential/trump-transition
  • fox-news/shows/v-full-ep-the-story
  • fox-news/media
  • article

d

Mark Cuban runs to 'less hateful' social media platform after scrubbing X account of Harris support

Dallas Mavericks minority owner Mark Cuban returned to the Bluesky social media platform with a post after weeks of contentious X posts.



  • 03659cc7-b9b2-59bb-a83a-a51c4f033588
  • fnc
  • Fox News
  • fox-news/sports/nba/dallas-mavericks
  • fox-news/sports/nba
  • fox-news/sports
  • fox-news/politics
  • fox-news/sports
  • article

d

Oregon man defaced synagogue with antisemitic graffiti multiple times: DOJ

A man from Eugene, Oregon, pleaded guilty to federal hate crimes on Tuesday after he spray-painted antisemitic graffiti on a synagogue in 2023 and 2024.



  • 4d913ae7-b00f-581c-8754-ee3ce43df202
  • fnc
  • Fox News
  • fox-news/us/us-regions/west/oregon
  • fox-news/topic/anti-semitism
  • fox-news/politics/justice-department
  • fox-news/politics/judiciary/federal-courts
  • fox-news/us
  • article

d

Trump nominates Pete Hegseth to serve as defense secretary

Former Fox News host Pete Hegseth has been selected by President-elect Trump to serve as his secretary of defense. Hegseth served in the U.S. Army.



  • 6fc74de4-5845-502a-9d77-cf6ca51f1b96
  • fnc
  • Fox News
  • fox-news/person/donald-trump
  • fox-news/politics/defense/secretary-of-defense
  • fox-news/politics/defense
  • fox-news/politics
  • fox-news/us
  • fox-news/politics
  • article

d

Deion Sanders said he would tell NFL teams son Shedeur Sanders won't play for them if it's not the right fit

Just like Eli Manning in 2004, Deion Sanders said he would tell NFL teams his son, Shedeur Sanders, won't play for them if it's not the right fit.



  • 2d69b8d3-c449-5d92-b6e9-8a2a28329025
  • fnc
  • Fox News
  • fox-news/sports/ncaa/colorado-buffaloes
  • fox-news/sports/ncaa-fb
  • fox-news/sports/nfl-draft
  • fox-news/sports/nfl
  • fox-news/sports
  • fox-news/sports
  • article

d

Trump's picks so far: Here's who will be advising the new president

Since winning the election last week, President-elect Trump has begun evaluating and rolling out his Cabinet picks, with dozens of names jockeying for some two dozen positions.



  • 0b65eed2-fb69-5522-a4e4-eb534bbb05e8
  • fnc
  • Fox News
  • fox-news/politics/executive/cabinet
  • fox-news/person/donald-trump
  • fox-news/politics/executive/white-house
  • fox-news/politics
  • fox-news/politics
  • article

d

Jessica Simpson sparks divorce rumors with cryptic post

Jessica Simpson sparked rumors this week with a cryptic post about making new music and having put up with "everything I did not deserve."



  • 73ca097a-ffd9-5842-be14-09233aebdc9a
  • fnc
  • Fox News
  • fox-news/person/jessica-simpson
  • fox-news/entertainment
  • fox-news/entertainment/music
  • fox-news/entertainment
  • article

d

SEAN HANNITY: America's massive bureaucracy will soon face a very heavy dose of reality again

Fox News host Sean Hannity says the "decentralization of power as our founders intended is very much on its way to DC."



  • db9b2382-87f4-598f-a2a5-f3e9d45fc8c8
  • fnc
  • Fox News
  • fox-news/shows/hannity
  • fox-news/shows/hannity/transcript/hannitys-monologue
  • fox-news/person/donald-trump
  • fox-news/media/fox-news-flash
  • fox-news/media
  • fox-news/media
  • article

d

JESSE WATTERS: Trump will send 'shockwaves' through DC

Jesse Watters takes a look at the administration that President-elect Trump is assembling and how they're planning on changing Washington on “Jesse Watters Primetime.”



  • b061fe4a-30d4-5a71-bd55-2aae119d8678
  • fnc
  • Fox News
  • fox-news/shows/jesse-watters-primetime
  • fox-news/media
  • fox-news/topic/fox-news-flash
  • fox-news/media
  • article

d

Georgia on outside of College Football Playoff bracket as wild week brings rankings shakeup

Georgia's loss to Ole Miss Saturday brought a wild shakeup to the college football rankings, and the Bulldogs find themselves out of the playoff picture.



  • be1a5b1e-e9fd-515d-8deb-af99e8d76913
  • fnc
  • Fox News
  • fox-news/sports/ncaa-fb
  • fox-news/sports/ncaa
  • fox-news/sports
  • fox-news/sports/ncaa/georgia-bulldogs
  • fox-news/sports/ncaa/oregon-ducks
  • fox-news/sports
  • article

d

Man arrested in NYC strangulation death of woman found outside Times Square hotel

Authorities arrested a man accused of strangling a woman outside a Times Square hotel who later died from her injuries, police said Tuesday.



  • d7d30f82-1959-5dbe-99be-c4c6d3d7b418
  • fnc
  • Fox News
  • fox-news/us/crime
  • fox-news/us/new-york-city
  • fox-news/us
  • fox-news/us
  • article

d

Trump selects South Dakota Gov Kristi Noem to run Department of Homeland Security

President-elect Trump announced on Tuesday that Kristi Noem is his pick for secretary of the Department of Homeland Security.



  • 9e2a0339-2cb6-5255-919a-162a332ea710
  • fnc
  • Fox News
  • fox-news/politics
  • fox-news/person/donald-trump
  • fox-news/person/kristi-noem
  • fox-news/politics
  • article

d

Republican Gabe Evans wins Colorado's 8th Congressional District, beating incumbent Yadira Caraveo

The Associated Press has declared a winner in Colorado's 8th Congressional District which has been one of the most closely watched races in the country.



  • a466e502-3378-573c-8ecc-0e628d1b45ea
  • fnc
  • Fox News
  • fox-news/politics
  • fox-news/us/us-regions/west/colorado
  • fox-news/politics/elections
  • fox-news/politics/house-of-representatives
  • fox-news/politics
  • article

d

Rick Scott gains new Senate endorsements out of candidate forum on eve of leader election

Senate Republicans met on Tuesday night to hear from the three candidates to succeed Mitch McConnell, and Rick Scott left with two new endorsements.



  • 6fb1e070-cf35-5dc6-9a29-2dd83f55001b
  • fnc
  • Fox News
  • fox-news/politics
  • fox-news/politics/senate
  • fox-news/person/donald-trump
  • fox-news/us/congress
  • fox-news/politics
  • article

d

Republican David Valadao wins re-election to US House in California's 22nd Congressional District

Incumbent Republican David Valadao is projected to emerge victorious in California's 22nd Congressional District. The highly contested race was considered to be a tossup.



  • 4451eb0e-c159-5978-bbc9-ce2be1359320
  • fnc
  • Fox News
  • fox-news/politics
  • fox-news/us/us-regions/west/california
  • fox-news/us/congress
  • fox-news/politics/elections/house-of-representatives
  • fox-news/politics
  • article

d

Senator-elect Jim Justice's team clarifies report claiming famous pooch Babydog banned from Senate floor

Senator-elect Jim Justice's office has clarified reports that his famous pooch Babydog was banned from the Senate floor, saying Justice never intended to bring the dog onto the floor.



  • 5e83cc3c-0f20-531a-a467-f5c5e2547352
  • fnc
  • Fox News
  • fox-news/politics
  • fox-news/politics/senate
  • fox-news/politics/elections/senate
  • fox-news/us/us-regions/southeast/west-virginia
  • fox-news/politics
  • article

d

Country star Darius Rucker donates to ETSU’s NIL fund after 'awkward' appearance at football game

Country music star Darius Rucker paid the East Tennessee State University's NIL fund $10 for every minute he was on the field Saturday after what he called an "awkward" appearance.



  • 322459dc-7f98-5929-8f3a-c2c829efc988
  • fnc
  • Fox News
  • fox-news/sports/ncaa/east-tennessee-state-buccaneers
  • fox-news/sports/ncaa
  • fox-news/sports
  • fox-news/topic/trending-news
  • fox-news/sports
  • article

d

Mutiny threat sparks House GOP infighting ahead of Trump visit: 'Just more stupid'

House Republicans are once again at odds with one another after conservatives threatened to protest Speaker Johnson's bid to lead the conference again.



  • 5cfa4a69-f5e8-544b-b124-e66551151a9a
  • fnc
  • Fox News
  • fox-news/politics/house-of-representatives
  • fox-news/politics/house-of-representatives/republicans
  • fox-news/person/mike-johnson
  • fox-news/politics
  • fox-news/politics
  • article

d

Bev Priestman out as Canadian women's head soccer coach following Olympic drone scandal probe

The Canadian women's soccer team was implicated in a drone scandal this past summer. But, an investigation determined drone use against opponents, predated the Paris Olympics.



  • 784150bb-7367-54e1-a4e5-8ad141b4e55e
  • fnc
  • Fox News
  • fox-news/sports/soccer
  • fox-news/world/world-regions/canada
  • fox-news/sports
  • fox-news/sports
  • article

d

GREG GUTFELD: Trump's incoming 'border czar' doesn't care what people think of him

'Gutfeld!' panelists react to President-elect Trump's choice for 'border czar.'



  • 9d54a038-0408-5bd5-bf0f-8234ceb4bc2e
  • fnc
  • Fox News
  • fox-news/media/fox-news-flash
  • fox-news/media
  • fox-news/shows/gutfeld
  • fox-news/shows/gutfeld/transcript-gutfeld
  • fox-news/opinion
  • article

d

Dolphins' Tyreek Hill floats latest theory about arrest near NFL stadium amid battle with wrist injury

In the first quarter of Monday's Dolphins-Rams game, ESPN reported that Tyreek Hill said a torn ligament in his wrist became worst after he was detained by police.



  • 62bb1d69-5e1c-51c7-ae39-4516d9fff977
  • fnc
  • Fox News
  • fox-news/sports/nfl/miami-dolphins
  • fox-news/sports/nfl
  • fox-news/person/tyreek-hill
  • fox-news/sports
  • fox-news/sports
  • article

d

Agencies tight-lipped on kickbacks

Australia’s leading media agencies have ducked questions about cash kickbacks.




d

Microsoft to acquire LinkedIn

Tech giant to pay $35.44 billion for social networking firm in surprise deal.




d

Delta puts Nine back in ratings

Delta Goodrem and her revolving chair have proved their star power, helping to reverse Nine’s horror start to the year.




d

Trump dumps ‘phony’ Post

The Trump campaign has revoked press credentials for the Washington Post, citing its Orlando coverage.




d

Fairfax-APN fears outlined

New Zealand’s competition watchdog has cited areas of overlap from a Fairfax-APN merger.




d

Advertising adds up to $40bn

Advertising spending contributes about $40 billion a year to the Australian economy, or 2 per cent of GDP.




d

How AI Will Change Chip Design



The end of Moore’s Law is looming. Engineers and designers can do only so much to miniaturize transistors and pack as many of them as possible into chips. So they’re turning to other approaches to chip design, incorporating technologies like AI into the process.

Samsung, for instance, is adding AI to its memory chips to enable processing in memory, thereby saving energy and speeding up machine learning. Speaking of speed, Google’s TPU V4 AI chip has doubled its processing power compared with that of its previous version.

But AI holds still more promise and potential for the semiconductor industry. To better understand how AI is set to revolutionize chip design, we spoke with Heather Gorr, senior product manager for MathWorks’ MATLAB platform.

How is AI currently being used to design the next generation of chips?

Heather Gorr: AI is such an important technology because it’s involved in most parts of the cycle, including the design and manufacturing process. There’s a lot of important applications here, even in the general process engineering where we want to optimize things. I think defect detection is a big one at all phases of the process, especially in manufacturing. But even thinking ahead in the design process, [AI now plays a significant role] when you’re designing the light and the sensors and all the different components. There’s a lot of anomaly detection and fault mitigation that you really want to consider.

Heather GorrMathWorks

Then, thinking about the logistical modeling that you see in any industry, there is always planned downtime that you want to mitigate; but you also end up having unplanned downtime. So, looking back at that historical data of when you’ve had those moments where maybe it took a bit longer than expected to manufacture something, you can take a look at all of that data and use AI to try to identify the proximate cause or to see something that might jump out even in the processing and design phases. We think of AI oftentimes as a predictive tool, or as a robot doing something, but a lot of times you get a lot of insight from the data through AI.

What are the benefits of using AI for chip design?

Gorr: Historically, we’ve seen a lot of physics-based modeling, which is a very intensive process. We want to do a reduced order model, where instead of solving such a computationally expensive and extensive model, we can do something a little cheaper. You could create a surrogate model, so to speak, of that physics-based model, use the data, and then do your parameter sweeps, your optimizations, your Monte Carlo simulations using the surrogate model. That takes a lot less time computationally than solving the physics-based equations directly. So, we’re seeing that benefit in many ways, including the efficiency and economy that are the results of iterating quickly on the experiments and the simulations that will really help in the design.

So it’s like having a digital twin in a sense?

Gorr: Exactly. That’s pretty much what people are doing, where you have the physical system model and the experimental data. Then, in conjunction, you have this other model that you could tweak and tune and try different parameters and experiments that let sweep through all of those different situations and come up with a better design in the end.

So, it’s going to be more efficient and, as you said, cheaper?

Gorr: Yeah, definitely. Especially in the experimentation and design phases, where you’re trying different things. That’s obviously going to yield dramatic cost savings if you’re actually manufacturing and producing [the chips]. You want to simulate, test, experiment as much as possible without making something using the actual process engineering.

We’ve talked about the benefits. How about the drawbacks?

Gorr: The [AI-based experimental models] tend to not be as accurate as physics-based models. Of course, that’s why you do many simulations and parameter sweeps. But that’s also the benefit of having that digital twin, where you can keep that in mind—it’s not going to be as accurate as that precise model that we’ve developed over the years.

Both chip design and manufacturing are system intensive; you have to consider every little part. And that can be really challenging. It’s a case where you might have models to predict something and different parts of it, but you still need to bring it all together.

One of the other things to think about too is that you need the data to build the models. You have to incorporate data from all sorts of different sensors and different sorts of teams, and so that heightens the challenge.

How can engineers use AI to better prepare and extract insights from hardware or sensor data?

Gorr: We always think about using AI to predict something or do some robot task, but you can use AI to come up with patterns and pick out things you might not have noticed before on your own. People will use AI when they have high-frequency data coming from many different sensors, and a lot of times it’s useful to explore the frequency domain and things like data synchronization or resampling. Those can be really challenging if you’re not sure where to start.

One of the things I would say is, use the tools that are available. There’s a vast community of people working on these things, and you can find lots of examples [of applications and techniques] on GitHub or MATLAB Central, where people have shared nice examples, even little apps they’ve created. I think many of us are buried in data and just not sure what to do with it, so definitely take advantage of what’s already out there in the community. You can explore and see what makes sense to you, and bring in that balance of domain knowledge and the insight you get from the tools and AI.

What should engineers and designers consider when using AI for chip design?

Gorr: Think through what problems you’re trying to solve or what insights you might hope to find, and try to be clear about that. Consider all of the different components, and document and test each of those different parts. Consider all of the people involved, and explain and hand off in a way that is sensible for the whole team.

How do you think AI will affect chip designers’ jobs?

Gorr: It’s going to free up a lot of human capital for more advanced tasks. We can use AI to reduce waste, to optimize the materials, to optimize the design, but then you still have that human involved whenever it comes to decision-making. I think it’s a great example of people and technology working hand in hand. It’s also an industry where all people involved—even on the manufacturing floor—need to have some level of understanding of what’s happening, so this is a great industry for advancing AI because of how we test things and how we think about them before we put them on the chip.

How do you envision the future of AI and chip design?

Gorr: It’s very much dependent on that human element—involving people in the process and having that interpretable model. We can do many things with the mathematical minutiae of modeling, but it comes down to how people are using it, how everybody in the process is understanding and applying it. Communication and involvement of people of all skill levels in the process are going to be really important. We’re going to see less of those superprecise predictions and more transparency of information, sharing, and that digital twin—not only using AI but also using our human knowledge and all of the work that many people have done over the years.




d

Andrew Ng: Unbiggen AI



Andrew Ng has serious street cred in artificial intelligence. He pioneered the use of graphics processing units (GPUs) to train deep learning models in the late 2000s with his students at Stanford University, cofounded Google Brain in 2011, and then served for three years as chief scientist for Baidu, where he helped build the Chinese tech giant’s AI group. So when he says he has identified the next big shift in artificial intelligence, people listen. And that’s what he told IEEE Spectrum in an exclusive Q&A.


Ng’s current efforts are focused on his company Landing AI, which built a platform called LandingLens to help manufacturers improve visual inspection with computer vision. He has also become something of an evangelist for what he calls the data-centric AI movement, which he says can yield “small data” solutions to big issues in AI, including model efficiency, accuracy, and bias.

Andrew Ng on...

The great advances in deep learning over the past decade or so have been powered by ever-bigger models crunching ever-bigger amounts of data. Some people argue that that’s an unsustainable trajectory. Do you agree that it can’t go on that way?

Andrew Ng: This is a big question. We’ve seen foundation models in NLP [natural language processing]. I’m excited about NLP models getting even bigger, and also about the potential of building foundation models in computer vision. I think there’s lots of signal to still be exploited in video: We have not been able to build foundation models yet for video because of compute bandwidth and the cost of processing video, as opposed to tokenized text. So I think that this engine of scaling up deep learning algorithms, which has been running for something like 15 years now, still has steam in it. Having said that, it only applies to certain problems, and there’s a set of other problems that need small data solutions.

When you say you want a foundation model for computer vision, what do you mean by that?

Ng: This is a term coined by Percy Liang and some of my friends at Stanford to refer to very large models, trained on very large data sets, that can be tuned for specific applications. For example, GPT-3 is an example of a foundation model [for NLP]. Foundation models offer a lot of promise as a new paradigm in developing machine learning applications, but also challenges in terms of making sure that they’re reasonably fair and free from bias, especially if many of us will be building on top of them.

What needs to happen for someone to build a foundation model for video?

Ng: I think there is a scalability problem. The compute power needed to process the large volume of images for video is significant, and I think that’s why foundation models have arisen first in NLP. Many researchers are working on this, and I think we’re seeing early signs of such models being developed in computer vision. But I’m confident that if a semiconductor maker gave us 10 times more processor power, we could easily find 10 times more video to build such models for vision.

Having said that, a lot of what’s happened over the past decade is that deep learning has happened in consumer-facing companies that have large user bases, sometimes billions of users, and therefore very large data sets. While that paradigm of machine learning has driven a lot of economic value in consumer software, I find that that recipe of scale doesn’t work for other industries.

Back to top

It’s funny to hear you say that, because your early work was at a consumer-facing company with millions of users.

Ng: Over a decade ago, when I proposed starting the Google Brain project to use Google’s compute infrastructure to build very large neural networks, it was a controversial step. One very senior person pulled me aside and warned me that starting Google Brain would be bad for my career. I think he felt that the action couldn’t just be in scaling up, and that I should instead focus on architecture innovation.

“In many industries where giant data sets simply don’t exist, I think the focus has to shift from big data to good data. Having 50 thoughtfully engineered examples can be sufficient to explain to the neural network what you want it to learn.”
—Andrew Ng, CEO & Founder, Landing AI

I remember when my students and I published the first NeurIPS workshop paper advocating using CUDA, a platform for processing on GPUs, for deep learning—a different senior person in AI sat me down and said, “CUDA is really complicated to program. As a programming paradigm, this seems like too much work.” I did manage to convince him; the other person I did not convince.

I expect they’re both convinced now.

Ng: I think so, yes.

Over the past year as I’ve been speaking to people about the data-centric AI movement, I’ve been getting flashbacks to when I was speaking to people about deep learning and scalability 10 or 15 years ago. In the past year, I’ve been getting the same mix of “there’s nothing new here” and “this seems like the wrong direction.”

Back to top

How do you define data-centric AI, and why do you consider it a movement?

Ng: Data-centric AI is the discipline of systematically engineering the data needed to successfully build an AI system. For an AI system, you have to implement some algorithm, say a neural network, in code and then train it on your data set. The dominant paradigm over the last decade was to download the data set while you focus on improving the code. Thanks to that paradigm, over the last decade deep learning networks have improved significantly, to the point where for a lot of applications the code—the neural network architecture—is basically a solved problem. So for many practical applications, it’s now more productive to hold the neural network architecture fixed, and instead find ways to improve the data.

When I started speaking about this, there were many practitioners who, completely appropriately, raised their hands and said, “Yes, we’ve been doing this for 20 years.” This is the time to take the things that some individuals have been doing intuitively and make it a systematic engineering discipline.

The data-centric AI movement is much bigger than one company or group of researchers. My collaborators and I organized a data-centric AI workshop at NeurIPS, and I was really delighted at the number of authors and presenters that showed up.

You often talk about companies or institutions that have only a small amount of data to work with. How can data-centric AI help them?

Ng: You hear a lot about vision systems built with millions of images—I once built a face recognition system using 350 million images. Architectures built for hundreds of millions of images don’t work with only 50 images. But it turns out, if you have 50 really good examples, you can build something valuable, like a defect-inspection system. In many industries where giant data sets simply don’t exist, I think the focus has to shift from big data to good data. Having 50 thoughtfully engineered examples can be sufficient to explain to the neural network what you want it to learn.

When you talk about training a model with just 50 images, does that really mean you’re taking an existing model that was trained on a very large data set and fine-tuning it? Or do you mean a brand new model that’s designed to learn only from that small data set?

Ng: Let me describe what Landing AI does. When doing visual inspection for manufacturers, we often use our own flavor of RetinaNet. It is a pretrained model. Having said that, the pretraining is a small piece of the puzzle. What’s a bigger piece of the puzzle is providing tools that enable the manufacturer to pick the right set of images [to use for fine-tuning] and label them in a consistent way. There’s a very practical problem we’ve seen spanning vision, NLP, and speech, where even human annotators don’t agree on the appropriate label. For big data applications, the common response has been: If the data is noisy, let’s just get a lot of data and the algorithm will average over it. But if you can develop tools that flag where the data’s inconsistent and give you a very targeted way to improve the consistency of the data, that turns out to be a more efficient way to get a high-performing system.

“Collecting more data often helps, but if you try to collect more data for everything, that can be a very expensive activity.”
—Andrew Ng

For example, if you have 10,000 images where 30 images are of one class, and those 30 images are labeled inconsistently, one of the things we do is build tools to draw your attention to the subset of data that’s inconsistent. So you can very quickly relabel those images to be more consistent, and this leads to improvement in performance.

Could this focus on high-quality data help with bias in data sets? If you’re able to curate the data more before training?

Ng: Very much so. Many researchers have pointed out that biased data is one factor among many leading to biased systems. There have been many thoughtful efforts to engineer the data. At the NeurIPS workshop, Olga Russakovsky gave a really nice talk on this. At the main NeurIPS conference, I also really enjoyed Mary Gray’s presentation, which touched on how data-centric AI is one piece of the solution, but not the entire solution. New tools like Datasheets for Datasets also seem like an important piece of the puzzle.

One of the powerful tools that data-centric AI gives us is the ability to engineer a subset of the data. Imagine training a machine-learning system and finding that its performance is okay for most of the data set, but its performance is biased for just a subset of the data. If you try to change the whole neural network architecture to improve the performance on just that subset, it’s quite difficult. But if you can engineer a subset of the data you can address the problem in a much more targeted way.

When you talk about engineering the data, what do you mean exactly?

Ng: In AI, data cleaning is important, but the way the data has been cleaned has often been in very manual ways. In computer vision, someone may visualize images through a Jupyter notebook and maybe spot the problem, and maybe fix it. But I’m excited about tools that allow you to have a very large data set, tools that draw your attention quickly and efficiently to the subset of data where, say, the labels are noisy. Or to quickly bring your attention to the one class among 100 classes where it would benefit you to collect more data. Collecting more data often helps, but if you try to collect more data for everything, that can be a very expensive activity.

For example, I once figured out that a speech-recognition system was performing poorly when there was car noise in the background. Knowing that allowed me to collect more data with car noise in the background, rather than trying to collect more data for everything, which would have been expensive and slow.

Back to top

What about using synthetic data, is that often a good solution?

Ng: I think synthetic data is an important tool in the tool chest of data-centric AI. At the NeurIPS workshop, Anima Anandkumar gave a great talk that touched on synthetic data. I think there are important uses of synthetic data that go beyond just being a preprocessing step for increasing the data set for a learning algorithm. I’d love to see more tools to let developers use synthetic data generation as part of the closed loop of iterative machine learning development.

Do you mean that synthetic data would allow you to try the model on more data sets?

Ng: Not really. Here’s an example. Let’s say you’re trying to detect defects in a smartphone casing. There are many different types of defects on smartphones. It could be a scratch, a dent, pit marks, discoloration of the material, other types of blemishes. If you train the model and then find through error analysis that it’s doing well overall but it’s performing poorly on pit marks, then synthetic data generation allows you to address the problem in a more targeted way. You could generate more data just for the pit-mark category.

“In the consumer software Internet, we could train a handful of machine-learning models to serve a billion users. In manufacturing, you might have 10,000 manufacturers building 10,000 custom AI models.”
—Andrew Ng

Synthetic data generation is a very powerful tool, but there are many simpler tools that I will often try first. Such as data augmentation, improving labeling consistency, or just asking a factory to collect more data.

Back to top

To make these issues more concrete, can you walk me through an example? When a company approaches Landing AI and says it has a problem with visual inspection, how do you onboard them and work toward deployment?

Ng: When a customer approaches us we usually have a conversation about their inspection problem and look at a few images to verify that the problem is feasible with computer vision. Assuming it is, we ask them to upload the data to the LandingLens platform. We often advise them on the methodology of data-centric AI and help them label the data.

One of the foci of Landing AI is to empower manufacturing companies to do the machine learning work themselves. A lot of our work is making sure the software is fast and easy to use. Through the iterative process of machine learning development, we advise customers on things like how to train models on the platform, when and how to improve the labeling of data so the performance of the model improves. Our training and software supports them all the way through deploying the trained model to an edge device in the factory.

How do you deal with changing needs? If products change or lighting conditions change in the factory, can the model keep up?

Ng: It varies by manufacturer. There is data drift in many contexts. But there are some manufacturers that have been running the same manufacturing line for 20 years now with few changes, so they don’t expect changes in the next five years. Those stable environments make things easier. For other manufacturers, we provide tools to flag when there’s a significant data-drift issue. I find it really important to empower manufacturing customers to correct data, retrain, and update the model. Because if something changes and it’s 3 a.m. in the United States, I want them to be able to adapt their learning algorithm right away to maintain operations.

In the consumer software Internet, we could train a handful of machine-learning models to serve a billion users. In manufacturing, you might have 10,000 manufacturers building 10,000 custom AI models. The challenge is, how do you do that without Landing AI having to hire 10,000 machine learning specialists?

So you’re saying that to make it scale, you have to empower customers to do a lot of the training and other work.

Ng: Yes, exactly! This is an industry-wide problem in AI, not just in manufacturing. Look at health care. Every hospital has its own slightly different format for electronic health records. How can every hospital train its own custom AI model? Expecting every hospital’s IT personnel to invent new neural-network architectures is unrealistic. The only way out of this dilemma is to build tools that empower the customers to build their own models by giving them tools to engineer the data and express their domain knowledge. That’s what Landing AI is executing in computer vision, and the field of AI needs other teams to execute this in other domains.

Is there anything else you think it’s important for people to understand about the work you’re doing or the data-centric AI movement?

Ng: In the last decade, the biggest shift in AI was a shift to deep learning. I think it’s quite possible that in this decade the biggest shift will be to data-centric AI. With the maturity of today’s neural network architectures, I think for a lot of the practical applications the bottleneck will be whether we can efficiently get the data we need to develop systems that work well. The data-centric AI movement has tremendous energy and momentum across the whole community. I hope more researchers and developers will jump in and work on it.

Back to top

This article appears in the April 2022 print issue as “Andrew Ng, AI Minimalist.”





d

Multiband Antenna Simulation and Wireless KPI Extraction



In this upcoming webinar, explore how to leverage the state-of-the-art high-frequency simulation capabilities of Ansys HFSS to innovate and develop advanced multiband antenna systems.

Overview

This webinar will explore how to leverage the state-of-the-art high-frequency simulation capabilities of Ansys HFSS to innovate and develop advanced multiband antenna systems. Attendees will learn how to optimize antenna performance and analyze installed performance within wireless networks. The session will also demonstrate how this approach enables users to extract valuable wireless and network KPIs, providing a comprehensive toolset for enhancing antenna design, optimizing multiband communication, and improving overall network performance. Join us to discover how Ansys HFSS can transform wireless system design and network efficiency approach.

What Attendees will Learn

  • How to design interleaved multiband antenna systems using the latest capabilities in HFSS
  • How to extract Network Key Performance Indicators
  • How to run and extract RF Channels for the dynamic environment

Who Should Attend

This webinar is valuable to anyone involved in antenna, R&D, product design, and wireless networks.

Register now for this free webinar!




d

Principles of PID Controllers



Thanks to their ability to adjust the system’s output accurately and quickly without detailed knowledge about its dynamics, PID control loops stand as a powerful and widely used tool for maintaining a stable and predictable output in a variety of applications. In this paper, we review the fundamental principles and characteristics of these control systems, providing insight into their functioning, tuning strategies, advantages, and trade-offs.

As a result of their integrated architecture, Zurich Instruments’ lock-in amplifiers allow users to make the most of all the advantages of digital PID control loops, so that their operation can be adapted to match the needs of different use cases.