At some point over the summer, Sunny got a little bit smarter.
Sunny, the artificially intelligent chatbot the city of Denver rolled out last spring, wasn’t roving the Denver interwebs or trolling neighborhood social networks. The genderless bot was just getting faster at what it was designed to do, mainly by remembering what it had already done.
“It’s simpler for Sunny to come back quickly with a response if it’s already gone through the workflow,” said Suma Nallapati, the city’s chief information officer who’s in charge of making sure the tech works for city employees and residents. “For example, (asking) what is my trash pickup day for this street? If it knows the address and if it knows the pickup day, it’s easier for it to answer that question the next time around.”
Baby steps, really. Sunny’s still in a crib to prevent it from escaping into the experimental world of generative AI, the game-changing tech popularized by OpenAI’s ChatGPT-4 that has machines creating new content. Sunny spent a year in training before a public debut last April, and after the city’s own generative AI use policy was drafted, vetted and approved.
Humans are still involved in feeding Sunny, to make sure its responses are appropriate, accurate and not, as they say in the AI biz, hallucinations. Top-ranked restaurants, which a local magazine asked Sunny about a few months ago, was excised from Sunny’s memory, since the city isn’t in the business of specific restaurant promotion. In the past six months, Sunny has handled 20% to 30% of calls and texts to the city’s 311 information service, which eases the workload of the human operators.
In a world where AI is developing so fast, Denver’s trying to carefully establish itself as a city that welcomes innovation to solve problems but also considers unintended consequences. It even organized next week’s DenAI Summit, touted as the nation’s first city-led conference on the topic. That’s in line with the state, where potential privacy, prejudice and piracy issues of AI led lawmakers to pass a law in May curbing some AI development. Colorado was first in the country with such a law, though challenges from the tech industry will likely result in revisions.
The Governor’s Office released its GenAI policy last month, which impacts all state agencies, said Amy Bhikha, chief data officer for the Governor’s Office of Information Technology. Anything with a generative AI component must pass OIT guidelines. GenAI can’t be used to make decisions “materially impacting individuals or entities.” In other words, vetting applicants for state benefits or funding, or an adverse action, like an arrest or detention, must rely on human decision makers.
OIT is also trying to figure out how tech like ChatGPT, Google’s Gemini or Microsoft Copilot can help employees in their jobs and assist residents with state services.
“We have a whole innovation piece that we’re setting up,” Bhikha said. “We’re doing a trial right now with Google Gemini. We have 150 people across all agencies using it and giving us feedback every week. And then we’re looking to potentially set up a lab in the future.”
A lab would allow staff to test out available AI tools like Grammarly and Read.ai, to quickly provide summaries and transcripts of meetings.
So far, none of the experiments have the potential to be public facing. But check back in a month, she said.
The speed of AI
AI and tech companies have been around for years in Colorado, with an ecosystem that includes machines that take fast-food orders, algorithms combating sepsis in hospitals and robots that sort recycling. Many consumers may not realize they’re already experiencing it, be it with transcribing meetings, getting help from customer service or searching on Google.
But for some young startups in the genAI space, growth has been lightning fast. Take Adeel Khan, for example. Two years ago, the Denver resident was on a break after more than a decade of teaching and working as a school administrator, including as the founding principal of Conservatory Green High School in Denver. He wasn’t thinking of starting a company.
Then ChatGPT-4 launched.
“I started trying to use it for things I would be doing as a teacher and principal and I found a lot of utility (and) I wondered if educators were using it,” Khan said. “I had no idea for a software company but I did what a principal would do, which is I went to my old school and I trained teachers on how to use ChatGPT. And in those sessions, (their) jaws were on the floor.”
He’d follow up weeks later only to find the teachers had stopped using it. They didn’t have time. They forgot what to do. They never figured out how to ask good prompts to achieve better responses. So Khan started MagicSchool in March 2023 as a digital helper. The service can quickly make a first attempt to generate lesson plans, create math problems or write letters to parents in the same way a teacher’s assistant would.
MagicSchool raised $2.4 million from local investors last year and went on to add $15 million more in venture capital in July. Khan now leads the 40-person company from his Denver living room. This week, it reached 3 million users.
“I think of AI as this really incredible opportunity to (help) educators and to assist them in their work, fight teacher burnout, help them be more efficient and also maybe augment (and) quickly refresh their knowledge on a subject they hadn’t taught before,” Khan said. “The second part is the student tool. We need to prepare students for a future where AI is everywhere. Next month, Apple will implement AI features in the iPhone. They’re already in Android phones. If we’re not teaching kids how to use AI in school responsibly, then we’re just leaving them to their own devices.”
But there are definitely lines MagicSchool won’t cross: Grades.
“We’ve made a lot of intentional decisions around this,” Khan said. “One thing we’ve intentionally left out is giving a grade. The grade is a high-stakes decision that could impact a child’s future. … The educator is still the center and decider.”
Past investments, future innovations
Venture capital has been paying a lot of attention to AI companies, which scooped up 41% of all U.S. VC investments in the first half of the year, according to PitchBook, a market research firm that tracks venture deals.
When Denver-based Range Ventures invested in MagicSchool in August 2023, the VC consensus was to avoid applications because larger AI companies, like OpenAI or Google, could build their own competitive service, said Adam Burrows, a managing director at the firm.
But there was something magical about Khan’s startup that made it a better prospect than the customer service startups others were chasing, Burrows said.
“We looked at the K-12 space and we said, ‘Hey, there’s actually no incumbent here.’ AI is allowing something to be built for teachers that has never been built before,” he said. “Our view was that AI was actually enabling an entire type of software that didn’t exist before. So we have been bullish on looking for more situations like that.”
Don’t Miss: AI & Colorado
Sept. 27, 2024: Curious about how generative AI is developing in Colorado? Then don’t miss this panel discussion with state and city IT officials, investors and startups. >> Details
Range Ventures focuses on Front Range companies and continues to invest in young AI startups, most recently HappyDoc, a note-taking administrative assistant for veterinarians. AI isn’t new to Range Ventures though. It invested about a decade ago in AMP, the robotics and automation company in Louisville that uses AI to sort recycling.
AMP has come a long way from its one-armed robot named Clarke, which used optical sensors, machine learning and AI to pick milk cartons out of a pile of moving recyclables.
The company, which has since raised more than $170 million from investors, now builds entire systems to sort recyclable material from plain ol’ trash without the touch of a human hand.
“What we’ve done with AI is created what we think of as a universal garbage sensor,” said Matanya Horowitz, AMP’s founder and CEO. “But rather than a robot that picks out aluminum cans, we think of the whole facility as a robot, like a 1,000-ton robot. It’s awesome.”
Years of training and scanning 150 billion items has helped AMP’s technology understand the differences between various types of plastics, metals and other recyclables versus actual trash, like chicken bones, diapers and “all the nasties,” he said. Its machines have even been trained to distinguish Starbucks cups (“We wanted to show that we had no issue getting down to the brand or packing level,” he said).
The AMP One systems are up and running in trash and recycling plants around the country, including at a municipal solid waste facility in Portsmouth, Virginia.
Like an Amazon warehouse where robots do most of the running around, there are few employees on the floor of an AMP-powered facility. There are still some humans though. AMP calls them data annotators who can correct the machines and teach them the difference between a Starbucks cup and an unbranded coffee cup, for example. Everything is just so much faster.
“The system can highlight things it’s uncertain about, giving more leverage to our data annotators,” he said. “It’ll say, ‘Not sure about these. Will you help me discriminate them?’ The person goes through and makes those corrections and what we’re finding is intelligent prioritization of the work can make human annotators 100 times more effective.”
While genAI use isn’t widespread on the floor, AMP engineers use it to code faster.
“AI tools are so powerful. I’ve seen it firsthand. The productivity out of developers is unreal,” he said. “Society will advance so much quicker because software development is about to become somewhere between 10 to 1,000-times more efficient. I think people want to be really thoughtful so that they don’t slow down the progress and put us at a disadvantage.
Nallapati, Denver’s CIO, said that’s part of the purpose behind the city’s all-day DenAI summit.
“The cognitive revolution is here and it’s again characterized by the automation of the cognitive process,” she said. “And we want Denver to build inclusive communities, and we want to make sure that ethical considerations and responsible AI practices are helping us (address) the vast impact on societal problems. We want to take advantage of every resource we have to solve the hard, complex problems we have.”
link