• Skip to primary navigation
  • Skip to main content
Progressive Gauge

Progressive Gauge

Media and Research

  • Home
  • About
  • Blog
  • Projects, Samples and Items
  • Video
  • Contact Jack
  • Show Search
Hide Search

IoT

OpenAI GPT-4o Lands with Mini Thud or: Generative AI balances Hype and Reality in Chatbot Market Quest

May 19, 2024 By Jack Vaughan

It’s still too early to gauge Generative AI’s limits. That is another way of saying a circus atmosphere of hyperbole and demo theatrics is far from played out. The word “plateau” is heard today, and maybe a leveling off is only natural.

But now the uncertain space of ‘what it can’t do yet’ is mined each day. If Generative AI efforts plateau, and it merely changes the chatbot market as we know it, Generative AI will go down as a really big large-language disappointment.

This week’s OpenAI rollout of GPT-4o didn’t help. One can’t blame the OpenAI crew for trying their best to present awe inspiring on-stage demos as they saddle onto Danish Modern furniture set that bodes a comforting future. After all, there’s need to show their labs’ work is world changing or — barring that — fun.

The upstart’s was one among other episodes in the week’s AI Wars, as OpenAI’s demo was joined by Google I/O’s product roll outs on another stage in another corner of the Web, reported by Sean Michael Kerner and others.

For their part, the OpenAI crew walked through pet tricks, such as, asking the applications to translate “Why do we do linear equations?” into sparkling Italian.

Google’s show was just as breathless.

Yes, for OpenAI, the free app is a step into a new realm. (Although, as George Lawton points out, “free” is always an onion to unpeel.) And, yes, it vastly surpasses a voice-to-text demo of the 1990s. Does it move the bar much further than the Smart Speaker did in the mid-2010s? Let an army of pundits ponder this.

Our take: OpenAI’s announcement of something akin to a free-tier product was a bit short on awe. We’d second Sharon Goldman of Fortune who marked GPT-4o as “OpenAI’s emotive on steroids voice assistant.”

Of course, more accessible and easier entry for a wider range of people is OpenAI’s ticket to broadening into consumer markets. That’s where the killer app that justifies big valuations may be. Gain the consumer, and the enterprise follows.

That’s where OpenAI will meet the public and duke it out with friends like AWS, Google and Microsoft. There’s Apple too, which is likely now prepping spirited demos that show it has heard the bubbling cries of drowning users of Siri.

The next battle will be different than what has come before for heavily financed OpenAI. This stage in the technology’s evolution brings the OpenAI boffins down from the high ground, They say “hello whitebread-light demo patter” — just like Google, AWS or Microsoft product managers!

For a company that’s gained outsized attention in big headline deals for crucial infrastructure for big cloud players, it’s time to move toward apps. If it is to gain ground on a big scale, it will have to reach consumers. We take that as a less than nuanced theme in the GPT-4o roll out.

Cousin IoT: Brave New World Update

As if by chance, we sat in on Transforma’s report on IoT markets this very same week. While ably detailing the currents and eddies of IoT in the decades to come It seemed to convey a message relevant to Gen AI’s future course.

It’s been a long time since IoT first promised a brave new technology future — and such promises were never quite on the scale of Generative AI — but IoT has been grinding away gainfully, nevertheless.

IoT industry players have faced the same kind of existential challenge that GenAI is about to encounter. That is: The need to find a killer consumer app that it can power.

Transforma’s recent survey reports that there were 16.1 billion active IoT devices at the end of 2033. Annual device sales will grow from 4.1 billion in 2023 to 8.7 billion (a CAGR of 8%).

Yet, the world — even the industrial market within the bigger world — seems little changed. IoT’s top use cases, now and looking forward, fall short in terms of the energetic dynamism represented in early visions of IoT that looked more like StarTrek or the Jetsons.

Transforma looking toward the top three IoT use cases in 2033 cited 1- electronic labels; 2-building lights; and 3-headphones. You can come knocking because the van is not rocking, at least in terms of excitement. Still, these use cases represent real businesses.

Now, the assertion here — that Generative AI will be viewed in the future much as IoT is viewed today — is tentative. The agreement here is likely inexact … but may be useful for predicasts. Finally, my purpose here is not to put-down these young technologists’ efforts, but just to suggest that OpenAI and underlying Generative AI are in for a tough fight. — Jack Vaughan

Big embedded player Infineon snags Tiny MLer Imagimob

May 24, 2023 By Jack Vaughan

Infineon Technologies AG  last week acquired Stockholm-based Imagimob AB, one of the most active players bringing AI to edge devices.

 

[Published May 24, 2023] – Germany-based chip maker Infineon Technologies AG  last week acquired Stockholm-based Imagimob AB, one of the most active players among a slew of startups seeking to bring AI-based machine learning to embedded devices on the edge of the Internet of Things (IoT). Terms were not disclosed.

 

Imagimob provides end-to-end development tools and cloud-based services intended to bring the much-vaunted capabilities of neural machine learning (ML) models from the cloud data center to edge devices. These devices have small footprints, rigorous memory limits, and strict constraints on power consumption. The aspiration to do a lot with little is summed up in the umbrella term “TinyML.”

 

The edge AI devices that Imagimob seeks to support also must cope with a wide variety of sensor types, including sensors that measure and analyze vision, movement, pressure, heat, velocity and other data formats. Business uses are broad, ranging from surveillance cameras and refrigerator monitors in retail settings to actuators and anomaly detectors in oil industry field equipment, and beyond.

 

Infineon’s Thomas Rostech said the purchase is based on his company’s contention that artificial Intelligence and machine learning are about to enter every embedded application, enabling new functionalities. In a statement, Rosteck, who is president of Infineon’s Connected Secure Systems division, boosted Imagimob’s platform and expertise in developing machine learning for edge devices.

 

In recent years, Infineon has worked to build out a portfolio of advanced sensors and IoT solutions. This is an area in which software is expected to play a key role. For example, the market for edge AI software is set to grow to €10.0B in 2032, from €738.5M in 2022, for a CAGR of 29.8% over the forecast period, according to Global Edge AI Software Market Research.

 

Founded in 2013, Imagimob tech- and business-side leaders came out of the mobile applications market. Since inception, its teams have worked on a wide variety of edge AI use cases. These include gunshot and other audio event detection, fall detection, condition monitoring, signal classifiers, safety vests, and more.

 

Imagimob has been highly active within the TinyML community, centered in part around the TinyML Foundation, which is dedicated to nurturing ultra-low power machine learning. Imagimob software has been demoed in showcases with Synaptics, Syntiant, Texas Instruments, and other edge AI hardware concerns.

 

Responding to request for comment, an Infineon spokesperson said the company plans to integrate Imagimob into its organizational structure and that customer relationships with Imagimob’s customers will continue, including partners working on competitor’s hardware, “in alignment with the compliance regulations.”

 

To date, IoT growth has been fitful in the enterprise, as businesses look to move past proof-of-concept projects and achieve return-on-investment. Potential enterprise application areas that include retail, healthcare, supply chain and other operations are places where processing data on the edge translates into cost savings versus processing data in the cloud. The need to off-load processing to the edge becomes more acute as data intensive AI and machine learning capabilities come into play. Imagimob efforts to enable AI’s march from data center to the Internet’s edge are expected to fill out more fully with the backing of the larger chip maker Infineon.

 

Enterprise IoT has lost some luster in recent years as vendors grapple with a very extensive array of use cases. Intelligence in the form of machine learning makes sense, and so does the rise of TinyML as a next stage in delivering on the wide promise of IoT. But deep resources and breakthroughs on the software development side are required. That is at the same time that the venture capital markets have become less benign. So, more matches such as Infineon’s and Imagimob can be anticipated. – Jack Vaughan

The Edge of AI

August 25, 2021 By Jack Vaughan

August 24, 2021 – By Jack Vaughan – Since it is early in the era of Edge AI, it is fair to say that vendors are still trying to uncover the best first places to deploy AI. The value in the data center is given, but outside the (relatively) friendly confines of the data center that game is a bit unpredictable.

That is a take away I gather from my recent research for Edge AI chips take to the Field for IoT World Today. I’d be glad to predict what’s next, but the tea leaves are a bit too scattered for that.

Edge AI may arguably have a longer lineage than people generally might realize. Language-specific LISP chips targeted AI in the 1980s, and we at Digital Design then devoted attention to the phenomenon – that although it was hard to conjure up three players for a well-rounded feature.

The dim consensus today is that lack of humongous data sets stalled AI back in those days. But, that being the case or not, it is clear more powerful 32-bit and 64-bit CPUs proved more capable for whatever AI needs you might have. More recently, GPUs, DSPs, and the TPU began to become the means for AI models to crunch on big data.

As our story shows, new memory approaches are part and parcel of the Edge AI gold rush. As I composed the piece, I looked for an analogy. It was far from a good fit, but the early days of the automobile seemed somewhat apt.

Fate did not foreordain that the gas-powered internal combustion engine would come to epitomize “the auto” for many, many years. Electric, steam, and gas powered engines vied. Gas won, for a good long stay and why? It’s just that a number of sympathetic trends aligned.

Poor inter-city roads augured against cars of any kind in the early going. But the gas engine benefited from better understanding of thermodynamics, and proved maintainable, economical, and fit well with emerging mass production practices. This, at a time when the fuel – refined oil – was inexpensive. But some hybrid flair was required: The invention of electric starters eased the way for mass adoption of the internal combustion engine. In recent years, electric vehicles have made inroads, but still face hurdles to wide acceptance.

Will any of our new Edge AI designs come to resemble the Stanley Steamer? It used the locomotive boiler as analogy, but ultimately failed. The internal combustion engine did what the Steamer didnt. Now, a step or two into the 21st Century, it may be due for replacement. What next will hold sway? We will see.

So, let’s get back to Edge AI. The divergent AI approaches now rolling out should see some consolidation over time. It took many years for the internal combustion engine to settle in as the way the world powered automobiles, and many designs have vied to replace it. But the infrastructure surrounding the engine is an important key to how things play out.

Nvidia, which gained a march on competitors with its GPUs for data center-based AI, is often cited as a leader in the development of tools for AI chips. Such “infrastructure” gives it an edge on the edge too. The company is adapting its hardware and tools for Edge AI. New arrivals have new approaches at the edge but must catch up, especially in terms of tooling, which will take time.

Finding the killer app is still ahead. Where are the Edge AI use cases? It’s still early to find something on par with the Internet recommendation engines and image recognition applications that powered Nvidia’s first AI forays. One thing that can be said is that we don’t see many drones in the sky or self-driving cars on the highway. These are often cited as the places where Edge AI will thrive.

What we see most immediately is a nation of surveillance cameras, a scattering of self-evaluating joggers and bike riders, and voice-activated speakers powered by assistants (I know what this latter thing is because I just asked the Google orb on my kitchen table what she was.) These are the visible targets, but there may be others near but still less visible.

Note:
The global smart speaker market size is expected to reach USD 24.09 billion by 2028 at a CAGR of 16.9%.
The global surveillance camera market is expected to reach US$39.13 billion in 2025, growing at a CAGR of 8.17% for the time period of 2021-2025.

Progressive Gauge

Copyright © 2025 · Jack Vaughan · Log in

  • Home
  • About
  • Blog
  • Projects, Samples and Items
  • Video
  • Contact Jack