by tyler | May 7, 2024 | Tech
OpenAI says that it’s developing a tool to let creators better control how their content’s used in training generative AI.
Called Media Manager, the tool — once it’s released — will allow creators and content owners to identify their works to OpenAI and specify how they want those works to be included or excluded from AI research and training.
The goal is to have the tool in place by 2025, OpenAI says, as the company works with “creators, content owners and regulators” toward a common standard.
“This will require cutting-edge machine learning research to build a first-ever tool of its kind to help us identify copyrighted text, images, audio and video across multiple sources and reflect creator preferences,” OpenAI writes in a blog post . “Over time, we plan to introduce additional choices and features.”
It’d seem Media Manager, whatever form it ultimately takes, is OpenAI’s response to growing criticism of its approach to developing AI, which relies heavily on scraping publicly available data from the web. Most recently, eight prominent U.S. newspapers including the Chicago Tribune sued OpenAI for copryright infringement relating to the company’s use of generative AI, accusing OpenAI of pilfering articles for training generative AI models that it then commercialized without compensating — or crediting — the source publications.
Generative AI models including OpenAI’s — the sorts of models that can analyze and generate text, images, videos and more — are trained on an enormous number of examples usually sourced from public sites and data sets. OpenAI and other generative AI vendors argue that fair use, the legal doctrine that allows for the use of copyrighted works to make a secondary creation as long as it’s transformative, shields their practice of scraping public data and using it for model training. But not everyone agrees.
OpenAI, in fact, recently argued that it would be impossible to create useful AI models absent copyrighted material.
But — to placate critics — OpenAI has allowed artists to “opt out” of and remove their work from the data sets that the company uses to train its more recent image-generating models. It’s also let website owners indicate via the robots.txt standard, which gives instructions about websites to web-crawling bots, whether content on their site can be scraped to AI model training.
These tools haven’t gone far enough, some content creators say.
Artists have described OpenAI’s opt-out workflow for images, which requires submitting an individual copy of each image to be removed along with a description, as onerous. And — as OpenAI itself acknowledges in the blog post today — OpenAI’s current solutions don’t address scenarios in which creators’ works are quoted, remixed or reposted on platforms that they don’t control.
Beyond OpenAI, a number of third parties are attempting to build universal provenance and opt-out tools for generative AI.
Startup Spawning AI , whose partners include Stability AI and Hugging Face, offers an app that identifies and tracks bots’ IP addresses to block scraping attempts, as well as a database where artists can register their works to disallow training by vendors who choose to respect the requests. Steg.AI , Imatag and the “No AI” Watermark Generator help creators establish ownership of their images by applying watermarks that are imperceptible to the human eye. And Nightshade , a project from the University of Chicago, “poisons” image data to render it useless or disruptive to AI model training.
by tyler | May 7, 2024 | Tech
Apple isn’t yet ready to unveil its broader AI strategy — it’s saving that for its Worldwide Developer Conference in June — but the tech giant did make sure to mention AI technologies across its device lineup at its iPad event on Tuesday . The company touted a new iPad Air as “an incredibly powerful device for AI;” its AI-powered features like visual lookup, subject lift and live text capture, among others; and, of course, its upgraded M4 chip, which features a neural engine that’s “dedicated to the acceleration of AI workloads.”
Tuesday’s theme focused on the new hardware devices themselves — devices like new iPads and an updated Apple Pencil — not on the AI advances Apple is making under the hood. But Apple made sure to note anytime its hardware advances could also help power AI technologies.
For instance, the iPad Air’s update, which now includes the M2 with a faster CPU, GPU and neural engine, was described as offering “powerful machine learning features,” like visual lookup , which can identify objects in photos; an AI-powered tool that can lift out a photo’s subject; and live text capture , which can copy, share, look up and translate text within the camera frame.
When Apple didn’t have its own AI tech to point to, it referenced third parties. While talking about the iPad Air, for example, Apple gave a shout-out to Pixelmator’s Photomator, which uses AI models trained on over 20 million professional images to improve photos with a single click.
Here’s everything Apple just announced at its Let Loose event, including new iPad Pro with M4 chip, iPad Air, Apple Pencil and more
Meanwhile, the iPad Pro jumped from being powered by the M2 to the new M4, the latest generation of Apple silicone, with a new CPU, next-gen GPU, and next-generation ML accelerators that Apple claims will deliver up to 50% faster performance than the M2. Of course, the company also played up the chip’s neural engine, or NPU, which is “dedicated to the acceleration of AI workloads.”
“Now while the chip industry is just starting to add NPUs to some of their processors, we’ve been including our industry-leading neural engine in our chip for years,” said John Ternus, Apple SVP, Hardware Engineering, during the event.
Consumers, however, are waiting to see what sort of use cases are in store for these hardware advances — and that’s something Apple didn’t yet go into detail about, despite having the opportunity to tease an iPadOS release with new AI features or other developer-focused announcements.
Instead, Apple ran through iPadOS’ existing features, like multitasking view Stage Manager and a display mode for creatives, dubbed Reference Mode.
Still, the company hinted that improved AI capabilities would soon be in the hands of iPadOS app developers, noting that the operating system software offers advanced frameworks, like CoreML, and that developers would be able to tap into its neural engine to deliver “powerful AI features right on device.”
In other apps, like Logic Pro, Apple added new AI-powered session players like a bass and keyboard player who can join a performance alongside the drummer already available. These AI-driven backing band members can also respond to feedback provided in the app, Apple said. The company mentioned, too, a machine learning-backed Logic Pro plug-in, ChromaGlow, for adding warmth to tracks.
Image Credits: Apple
Image Credits: Apple
Apple made note of how AI could solve problems in areas like photography, like when trying to scan documents using a device’s camera.
“We’ve all had the experience of trying to scan a document in certain lighting conditions where it’s hard to avoid casting a shadow,” Ternus said. “The new Pro solves this problem. It uses AI to automatically detect documents like forms and receipts. If shadows are in the way it instantly takes multiple photos with the new adaptive flash. The frames are stitched together and the result is a dramatically better scan.”
Though none of the mentions of AI stood out as being over-the-top breakthroughs, they suggested that Apple’s style would be to note AI improvements as it related to upgrading the consumer experience of using its devices.
We expect to hear a lot more about Apple’s AI plans at WWDC, where the company may even announce an AI-powered Siri or partnership with an AI provider like Google or OpenAI , rumors suggest.
The new iPad Pros are Apple’s first devices powered by its M4 chip
by tyler | Apr 25, 2024 | Tech
AI is supercharging coding — and developers are embracing it.
In a recent StackOverflow poll, 44% of software engineers said that they use AI tools as part of their development processes now and 26% plan to soon. Gartner estimates that over half of organizations are currently piloting or have already deployed AI-driven coding assistants, and that 75% of developers will use coding assistants in some form by 2028.
Ex-Microsoft software developer Igor Ostrovsky believes that soon, there won’t be a developer who doesn’ t use AI in their workflows. “Software engineering remains a difficult and all-too-often tedious and frustrating job, particularly at scale,” he told TechCrunch. “AI can improve software quality, team productivity and help restore the joy of programming.”
So Ostrovsky decided to build the AI-powered coding platform that he himself would want to use.
That platform is Augment , and on Wednesday it emerged from stealth with $252 million in funding at a near-unicorn ($977 million) post-money valuation. With investments from former Google CEO Eric Schmidt and VCs including Index Ventures, Sutter Hill Ventures, Lightspeed Venture Partners, Innovation Endeavors and Meritech Capital, Augment aims to shake up the still-nascent market for generative AI coding technologies.
“Most companies are dissatisfied with the programs they produce and consume; software is too often fragile, complex and expensive to maintain with development teams bogged down with long backlogs for feature requests, bug fixes, security patches, integration requests, migrations and upgrades,” Ostrovsky said. “Augment has both the best team and recipe for empowering programmers and their organizations to deliver high-quality software quicker.”
Ostrovsky spent nearly seven years at Microsoft before joining Pure Storage, a startup developing flash data storage hardware and software products, as a founding engineer. While at Microsoft, Ostrovsky worked on components of Midori, a next-generation operating system the company never released but whose concepts have made their way into other Microsoft projects over the last decade.
In 2022, Ostrovsky and Guy Gur-Ari, previously an AI research scientist at Google, teamed up to create Augment’s MVP. To fill out the startup’s executive ranks, Ostrovsky and Gur-Ari brought on Scott Dietzen, ex-CEO of Pure Storage, and Dion Almaer, formerly a Google engineering director and a VP of engineering at Shopify.
Augment remains a strangely hush-hush operation.
In our conversation, Ostrovsky wasn’t willing to say much about the user experience or even the generative AI models driving Augment’s features (whatever they may be) — save that Augment is using fine-tuned “industry-leading” open models of some sort.
He did say how Augment plans to make money: standard software-as-a-service subscriptions. Pricing and other details will be revealed later this year, Ostrovsky added, closer to Augment’s planned GA release.
“Our funding provides many years of runway to continue to build what we believe to be the best team in enterprise AI,” he said. “We’re accelerating product development and building out Augment’s product, engineering and go-to-market functions as the company gears up for rapid growth.”
Rapid growth is perhaps the best shot Augment has at making waves in an increasingly cutthroat industry.
Practically every tech giant offers its own version of an AI coding assistant. Microsoft has GitHub Copilot, which is by far the firmest entrenched with over 1.3 million paying individual and 50,000 enterprise customers as of February. Amazon has AWS’ CodeWhisperer. And Google has Gemini Code Assist, recently rebranded from Duet AI for Developers.
Elsewhere, there’s a torrent of coding assistant startups: Magic , Tabnine , Codegen , Refact , TabbyML , Sweep , Laredo and Cognition (which reportedly just raised $175 million), to name a few. Harness and JetBrains, which developed the Kotlin programming language, recently released their own . So did Sentry (albeit with more of a cybersecurity bent).
Can they all — plus Augment now — do business harmoniously together? It seems unlikely. Eye-watering compute costs alone make the AI coding assistant business a challenging one to maintain. Overruns related to training and serving models forced generative AI coding startup Kite to shut down in December 2022. Even Copilot loses money , to the tune of around $20 to $80 a month per user, according to The Wall Street Journal.
Ostrovsky implies that there’s momentum behind Augment already; he claims that “h undreds” of software developers across “dozens” of companies, including payment startup Keeta (which is also Eric Schmidt-backed), are using Augment in early access. But will the uptake sustain? That’s the million-dollar question, indeed.
I also wonder if Augment has made any steps toward solving the technical setbacks plaguing code-generating AI, particularly around vulnerabilities.
An analysis by GitClear, the developer of the code analytics tool of the same name, found that coding assistants are resulting in more mistaken code being pushed to codebases, creating headaches for software maintainers. Security researchers have warned that generative coding tools can amplify existing bugs and exploits in projects. And Stanford researchers have found that developers who accept code recommendations from AI assistants tend to produce less secure code.
Then there’s copyright to worry about.
Augment’s models were undoubtedly trained on publicly available data, like all generative AI models — some of which may’ve been copyrighted or under a restrictive license. Some vendors have argued that fair use doctrine shields them from copyright claims while at the same time rolling out tools to mitigate potential infringement. But that hasn’t stopped coders from filing class action lawsuits over what they allege are open licensing and IP violations.
To all this, Ostrovsky says: “Current AI coding assistants don’t adequately understand the programmer’s intent, improve software quality nor facilitate team productivity, and they don’t properly protect intellectual property. Augment’s engineering team boasts deep AI and systems expertise. We’re poised to bring AI coding assistance innovations to developers and software teams.”
Augment, which is based in Palo Alto, has around 50 employees; Ostrovsky expects that number to double by the end of the year.
by tyler | Apr 25, 2024 | Tech
JioCinema, the popular Indian on-demand video-streaming service, introduced a new monthly subscription plan on Wednesday, with the lowest tier costing just 35 cents. The revamp in the pricing strategy comes as the market-leading service seeks to exert greater pressure on rivals including Netflix and Prime Video and “redefine the narrative of premium entertainment.”
The service — backed by Asia’s richest man, Mukesh Ambani — introduced two monthly tiers: 89 Indian rupees ($1), featuring support for four simultaneous screen access, and Rs 29, with single-screen access. Apart from the simultaneous viewing, both tiers offer identical features, including an ad-free experience, as well as the ability to stream in 4K and download for offline viewing.
JioCinema Premium also includes access to everything else on the platform, which includes a vast library of content from Peacock, HBO, Paramount and Warner Bros. Discovery .
Ambani’s JioCinema secures NBCUniversal titles, escalates Netflix and Disney rivalry
JioCinema had launched an annual premium tier with the international catalog at Rs 999 last year. Viacom18, the parent firm of JioCinema, is discontinuing the earlier tier, and those who had subscribed to it will be automatically switched over to the new plan, according to the spokesperson.
Sports content, including the ongoing cricket tournament Indian Premier League, will remain free to stream, but with ads. (The premium tier will not remove ads from the live sports content.)
The revamp in the pricing follows Ambani’s Reliance — which owns the majority of Viacom18 — merging its media business with the local unit of Disney earlier this year. The joint venture, whose value has been pegged at $8.5 billion, stands to capture 85% of India’s on-demand streaming service audience and about half of the TV viewers, according to analysts. Disney operates the popular streaming service Hotstar in India and Southeast Asia.
JioCinema is also undercutting rivals Netflix and Prime Video with its new 35-cent premium tier, a fraction of their cheapest plans priced at $2.40 and $2.15, respectively, in India.
Reliance and Disney also agreed two years ago to spend about $6 billion on the five-year streaming and broadcasting rights of Indian Premier League. Though Viacom18 plans to continue to offer an ad-supported Indian Premier League streaming experience at no charge to consumers, it does plan to recover much of the investment it has made in the next three years.
“Creating and building an entertainment ecosystem with a product that is made for every Indian household, is not just a business strategy, but a vision to empower our country and users with an unmatched entertainment experience,” said Kiran Mani, CEO of Viacom18 Digital, in a statement. “JioCinema Premium aims to redefine the narrative of premium entertainment for every Indian while building a daily viewing habit.”
Disney’s Hotstar tops 50 million concurrent viewers in India-New Zealand cricket clash
by tyler | Apr 25, 2024 | Tech
If there’s one overarching takeaway from last night’s Rabbit R1 launch event, it’s this: Hardware can be fun again. After a decade of unquestioned smartphone dominance, there is, once again, excitement to be found in consumer electronics. The wisdom and longevity of any individual product or form factor — while important — can be set aside for a moment. Just sit back and enjoy the show.
Despite flying out of an airport on a monthly basis, last night was my first night at the TWA Hotel nestled among the labyrinthian turnoffs of JFK’s Terminal 5. One rarely stays at hotels where they live, after all. The space is a nod to another era, when people dressed up to board flights and smiling chefs carved up entire legs of ham .
Image Credits: Brian Heater
Image Credits: Brian Heater
A rented DeLorean decked in Rabbit branding was parked out front, serving as a postmodern homage to the event’s decade-agnostic embrace of the past. Less glaring was the Ritchie Valens song sandwiched between Motown hits on the elevator speakers as we rode three floors down to the subterranean event space.
Hundreds of attendees were already lined up by the time I arrived at the space. Familiar faces from the world of tech journalism mulled about, but a considerable number were excited early adopters. The two groups were distinguished with “Press” and “VIP” lanyards, respectively. A man standing in front of me in the queue volunteered that he had flown out from Los Angeles specifically for the event.
Like Humane, the team at Rabbit is clearly invested in spectacle. The approaches are similar, but different, with the former investing a good deal of funding into viral videos, including an eclipse teaser that clearly fancied itself a kind of spiritual successor to Apple’s famous “1984” spot. One gets the sense, however, that Rabbit genuinely didn’t anticipate just how much of a buzz the company’s CES 2024 debut would generate.
“When we started building r1, we said internally that we’d be happy if we sold 500 devices on launch day,” the company posted on X . “In 24 hours, we already beat that by 20x!”
It would have been difficult to time the release better. Generative AI hype had reached a fever pitch. Humane had unveiled but had yet to release its Ai Pin. Intel was declaring 2024 the year of the AI PC and soon enough, Samsung would be doing the same for the smartphone. Apple, meanwhile, was promising its own big news on that front in the coming months .
Image Credits: Brian Heater
Image Credits: Brian Heater
When putting on a big show, a tech company also needs to dress the part. The focus on product design is another key parallel between Rabbit and Humane. While the form factors are vastly different, both the Ai Pin and R1 are testaments to value of industrial design. For its part, Rabbit took a page out of the Nothing playbook , contracting the stalwarts at Teenage Engineering to create a wildly original-looking product. Indeed, the R1 looks as much like an art piece as anything. It’s a squat, orange object — something you might want to mount to the handlebars of your bicycle for inclement weather.
While the Ai Pin’s defining physical characteristic is its absence of a display, Rabbit embraces the screen — if only modestly so. The display is a mere 2.88 inches and at times feels almost incidental to the cause. That goes double for its touch functionality. While, much like the Ai Pin, a bulk of your interactions are performed with voice, a combination analog scroll and button mostly fill in the gaps.
Beyond entering a Wi-Fi password, there aren’t a ton of reasons to touch the screen. That’s for the best. The most monumental and ongoing task facing the nascent AI device space is justifying its existence outside of the smartphone. After all, anyone with a half-decent mobile device (and plenty of non-decent ones) has access to generative AI models. These are largely accessed via browsers or stand-alone apps at the moment, but models like ChatGPT and Google Gemini will be increasingly baked into mobile operating systems in the months and years to come.
Image Credits: Brian Heater
Image Credits: Brian Heater
When I posed the question to Humane, co-founder and CEO Bethany Bongiorno offered the following anecdote: “[Humane’s co-founders] had gone to this dinner, and there was a family sitting next to us. There were three kids and a mom and dad, and they were on their phones the entire time. It really started a conversation about the incredible tool we built, but also some of the side effects.”
The Ai Pin’s absence of a screen is, in essence, a feature. Again, there’s plenty of cause to question the wisdom and efficacy of that design decision, but regardless, it’s crucial to the product. It’s worth noting that at $199, the barrier of price justification is significantly lower than the Ai Pin’s asking price.
Brian Heater
Brian Heater
The truth is that, at this early first-gen stage, novelty is a massive selling point. You either see the appeal of a devoted LLM accessing device or you don’t. Rabbit’s relatively affordable price point opens this world quite a bit. You should also consider that the R1 doesn’t require a monthly service fee, whereas Humane is charging you $24/month for functionality. That, coupled with the (albeit limited) touchscreen and really stellar design, and you can understand why the product has taken a good bit of wind out of the Ai Pin’s sails.
Neither of the devices trade in apps the way modern smartphones do. You interact exclusively with the onboard operating system. This can, however, be connected to other accounts, including Spotify, Uber, Midjourney and DoorDash. The system can take voice recordings and do bidirectional translations. The system can also gain environmental context via the onboard camera.
The Rabbit R1’s AI vision feature is a mixed bag. It also varies quite a bit from capture to capture, including the details it recognizes and the context it offers. (Apologies for the construction noise) pic.twitter.com/lf7WcOt8Rz
— Brian Heater (@bheater) April 24, 2024
Among the first tests I threw at it was offering a description of my bookshelf. I pointed the camera at a row of four hardcovers: “Moby Dick” by Herman Melville; “The Barbary Coast” by Herbert Asbury; “Understanding Media” by Marshall McLuhan; and “Dodsworth” by Sinclair Lewis. It universally had difficulty with the last book — understandably, as it was the least clear of the group.
It largely spotted and understood what it was seeing with “Moby Dick,” calling it a “classic” and sometimes offering a brief synopsis. It recognized the middle two books 50% to 75% of the time. It also attempted to offer some context as to the curatorial choices and sometimes went out on a limb to compliment said curation.
There were times, however, when the context was a bit much. I asked the R1 when the Oakland A’s are playing (I added the city after an initial inquiry for just “A’s” showed up as “Ace”), and it gave me tonight’s game time, before running down a list of the next 10 or so teams they’re playing. But hey, I’m a lifelong A’s fan. I relish such defeats.
Image Credits: Brian Heater
Image Credits: Brian Heater
Something worth noting for all of these early-stage write-ups is that these sorts of devices are designed to improve and customize results the more you use them. I’m writing this after having only picked up the device last night. I’m going to send it off to Devin for a more in-depth write-up.
Having only played around with the R1 for a few hours, I can definitively tell you that it’s a more accessible device than the Humane Pin, courtesy of the touchscreen and price. It doesn’t solve the cultural screen obsession Humane is interested in — nor does it seem to be shooting for such grandiose ambitions in the first place. Rather, it’s a beautifully designed product that offers a compelling insight into where things may be headed.
by tyler | Apr 25, 2024 | Tech
IBM wisely gravitated away from trying to be a pure cloud infrastructure vendor years ago, recognizing that it could never compete with the big three: Amazon, Microsoft and Google. It has since moved on to helping IT departments manage complex hybrid environments, using its financial clout to acquire a portfolio of high-profile companies.
It began with the $34 billion Red Hat acquisition in 2018, continued with the Apptio acquisition last year and it kept it going on Wednesday when the company announced that it would be acquiring cloud management vendor HashiCorp for $6.4 billion.
With HashiCorp, Big Blue gets a set of cloud lifecycle management and security tools, and a company that is growing considerably faster than any of IBM’s other businesses — although the revenue is small by IBM standards: $155 million last quarter, up 15% over the prior year. That still makes it a healthy and growing business for IBM to add to its growing stable of hybrid cloud tools.
IBM CEO Arvind Krishna certainly sees the value of this piece to his company’s hybrid strategy, and he even threw in an AI reference for good measure. “HashiCorp has a proven track record of enabling clients to manage the complexity of today’s infrastructure and application sprawl. Combining IBM’s portfolio and expertise with HashiCorp’s capabilities and talent will create a comprehensive hybrid cloud platform designed for the AI era,” he said in a statement.
HashiCorp made headlines last year when it changed the license on its open source Terraform tool to be more friendly to the company. The community that helped build Terraform wasn’t happy and responded by launching a new open source alternative called OpenTofu. HashiCorp recently accused the new community of misusing Terraform’s open source code when it created the OpenTofu fork. Now that the company is part of IBM, it will be interesting to see if they continue to pursue this line of thinking.
It’s worth noting that Red Hat also made headlines last year when it changed its open source licensing terms , also causing consternation in the open source community. Perhaps these companies will fit well together, both from a software perspective and their shifting views on open source.
Just this week, the company introduced a new platform concept with the release of the Infrastructure Cloud , a concept that should fit nicely inside IBM’s hybrid cloud product catalog. While they didn’t add much in terms of functionality, it did unify the offerings under a single umbrella, making it easier for sales and marketing to present to customers.
Why SUSE is forking Red Hat Enterprise Linux
If IBM treats HashiCorp in a similar way to Red Hat, the company would maintain its independence inside the IBM family of products. AVOA, a research firm run by former CIO Tim Crawford, says the company would be wise to keep it neutral.
“My reservation would be if IBM moves away from Hashicorp’s neutral stance in working with multiple cloud providers and focuses on IBM Cloud. I suspect that would not be the case as IBM has recently shown how they are more open with other cloud providers,” Crawford wrote in a recent blog post .
HashiCorp was founded in 2012 and raised almost $350 million before going public in 2021.
