How to Deploy and Scale Generative AI Efficiently and Cost-Effectively

How to Deploy and Scale Generative AI Efficiently and Cost-Effectively


For business leaders and developers alike, the question isn’t why generative artificial intelligence is being deployed across industries, but how—and how can we put it to work faster and with high performance?

The launch of ChatGPT in November 2022 marked the beginning of the large language model (LLM) explosion among end-users. LLMs are trained on vast amounts of data while providing the versatility and flexibility to simultaneously perform such tasks as answering questions, summarizing documents, and translating languages.

Today, organizations seek generative AI solutions to delight customers and empower in-house teams in equal measure. However, only 10% of companies worldwide are using generative AI at scale, according to McKinsey’s State of AI in early 2024 survey.

To continue to develop cutting-edge services and stay ahead of the competition, organizations must deploy and scale high-performance generative AI models and workloads securely, efficiently, and cost-effectively.

Accelerating Reinvention

Business leaders are realizing the true value of generative AI as it takes root across multiple industries. Organizations adopting LLMs and generative AI are 2.6 times more likely to increase revenue by at least 10%, according to Accenture.

However, as many as 30% of generative AI projects will be abandoned after proof of concept by 2025 due to poor data quality, inadequate risk controls, escalating costs, or unclear business value, according to Gartner. Much of the blame lies with the complexity of deploying large-scale generative AI capabilities.

Deployment Considerations

Not all generative AI services are created equal. Generative AI models are tailored to handle different tasks. Most organizations need a variety of models to generate text, images, video, speech, and synthetic data. They often choose between two approaches to deploying models:

1. Models built, trained, and deployed on easy-to-use third-party managed services.

2. Self-hosted solutions that rely on open-source and commercial tools.

Managed services are easy to set up and include user-friendly application programming interfaces (APIs) with robust model choices to build secure AI applications.

Self-hosted solutions require custom coding for APIs and further adjustment based on existing infrastructure. And organizations that choose this approach must factor in ongoing maintenance and updates to foundation models.

Ensuring an optimal user experience with high throughput, low latency, and security is often difficult to achieve on existing self-hosted solutions, where high throughput denotes the ability to process large volumes of data efficiently and low latency refers to the minimal delay in data transmission and real-time interaction.

Whichever approach an organization adopts, improving inference performance and keeping data secure is a complex, computationally intensive, and often time-consuming task.

Project Efficiency

Organizations face a few barriers when deploying generative AI and LLMs at scale. If not dealt with swiftly or efficiently, project progress and implementation timelines could be significantly delayed. Key considerations include:

Achieving low latency and high throughput. To ensure a good user experience, organizations need to respond to requests quickly and maintain high token throughput to scale effectively.

Consistency. Secure, stable, standardized inference platforms are a priority for most developers, who value an easy-to-use solution with consistent APIs.

Data security. Organizations must protect company data, client confidentiality, and personally identifiable information (PII) according to in-house policies and industry regulations.

Only by overcoming these challenges can organizations unleash generative AI and LLMs at scale.

Inference Microservices

To get ahead of the competition, developers need to find cost-efficient ways to enable the rapid, reliable, and secure deployment of high-performance generative AI and LLM models. An important measurement for cost efficiency is high throughput and low latency. Together, they have an impact on the delivery and efficiency of AI applications.

Easy-to-use inference microservices that run data through trained AI models connected to small independent software services with APIs can be a game-changer. They can provide instant access to a comprehensive range of generative AI models with industry-standard APIs, expanding into open-source and custom foundation models, that can seamlessly integrate with existing infrastructure and cloud services. They can help developers overcome the challenges that come with building AI applications while optimizing model performance and allowing for both high throughput and low latency.

Enterprise-grade support is also essential for businesses running generative AI in production. Organizations save valuable time by getting continuous updates, dedicated feature branches, security patching, and rigorous validation processes.

Hippocratic AI, a leading healthcare startup focused on generative AI, uses inference microservices to deploy over 25 LLMs, each with more than 70 billion parameters, to create an empathetic customer service agent avatar with increased security and reduced AI hallucinations. The underlying AI models, totaling over 1 trillion parameters, have led to fluid, real-time discussions between patients and virtual agents.

Generate new possibilities

Generative AI is transforming the way organizations do business today. As this technology continues to grow, businesses need the benefit of low latency and high throughput as they deploy generative AI at scale.

Organizations adopting inference microservices to address these challenges securely, efficiently, and economically can position themselves for success and leading their sectors.


Learn more about NVIDIA NIM inference microservices on AWS.


Source link

Bedford Media makes key appointments at i-D

Bedford Media makes key appointments at i-D

Published



October 17, 2024

Karlie Kloss’s Bedford Media continues to make key appointments as it puts support behind its reborn i-D and has created two new roles.

Jamie Reid

Jamie Reid is now global creative director and Steff Yotka is global editorial director of the publication and will work with its global editor-in-chief and chief brand officer Thom Bettridge “to collectively steer the publication’s creative, editorial, and brand for i-D across digital and print channels to emerging commercial platforms”. 

The company said that “together, the new leadership team will hone the focus of i-D back to its roots of blurring the lines of fashion, music, art, film and culture, through a reinvigorated lens”.

Reid will lead a creative team “to develop a distinct visual identity for i-D, ushering in a new era for a brand that has always been known for its ability to invent and reinvent”. His background is in editorial art direction and graphic design, including former roles at Dazed and Confused, Arena Homme+, and POP magazine.

Steff Yotka

Meanwhile Yotka has previously worked for SSense, Vogue, and Style.com with the firm saying she “brings a fearless approach to editorial, guiding the [i-D] brand’s print, digital, social, and video storytelling. Her past work… speaks to her eagerness to discover emerging talents and invent new formats for reporting on the new and the now”.

The print version of the publication will return next March and will be published bi-annually.

Copyright © 2024 FashionNetwork.com All rights reserved.


Source link

Sam Altman’s Eye-Scanning Orb Has a New Look—and Will Come Right to Your Door

Sam Altman’s Eye-Scanning Orb Has a New Look—and Will Come Right to Your Door

While the biometric-scanning Orb and the World network have their roots in crypto tokens, “crypto” wasn’t an oft-mentioned word during the event. Instead, Altman and Blania emphasized World’s blockchain service, digital asset management, and virtual communication tools.

Blania claimed during the press briefing that, in the future, World hopes to build the “largest finance network” on the planet.

In a separate interview with WIRED, Blania said that during regular Sunday meetings at Atlman’s house, the pair were inspired by the rise of PayPal. Similar to the way that Peter Thiel, Max Levchin, and others once pioneered digital payments and fundamentally changed online commerce—becoming billionaires themselves in the process—the World team saw themselves building out a similar network for tokens on a distributed network.

The World app, for now, is free for everyone to use. It’s free to scan your eyeballs, too. Tools for Humanity itself is venture-backed, and the foundation, in its land grab for the modern identity verification market and your personal biometric data, is focused on scale, scale, scale. Eventually, it may make money through processing fees, Blania said.

Most of Tools for Humanity’s expansion plans for now are in locations outside of the US, due to murky regulations around crypto stateside, the organization’s spokesperson told me.

If you use the Orb and compatible app in the US, it will scan and store your iris but won’t generate a crypto token for you.

Two and a half years ago, the Worldcoin project came under scrutiny for allegedly deceptive and exploitative practices in recruiting individuals to scan their irises. At the time, Blania attributed this haphazard behavior to the organization still being in its “startup” phase. In an interview with WIRED, Blania said the company is doing “like, a thousand things” to ensure a more rigorous consent process. This includes staffing an “operational team” in every market where World will be. He said there will be “explanations” in the World app for how the product works.

“And again, there is no data stored in any central place or anything,” Blania said.

In 2023, the service was also being investigated by governments in Germany, Brazil, India, South Korea, and Kenya over concerns about how it was storing and using biometric data. Kenya suspended Worldcoin enrollment entirely. South Korea fined the company. Worldcoin suspended its own service in India, Brazil, and France.

Blania said he believes World will relaunch in Kenya “sometime soon.”

When asked in the press briefing about the emphasis on Latin America as a market for expansion, such as through the partnership with Rappi for orbs-on-delivery, Blania disputed the idea that World was prioritizing Latin America over other locations.

“It’s just that we have limited resources, and there’s a natural sequencing happening,” Blania said. “We are similarly focused on Asia and other places. Argentina has been a fast-growing market for us, for example, and we’re excited about that.”

“But the project is literally called World,” he added.

After the keynote, Altman ran into the press room to wave and apologize for not being able to stay, then slipped away like a head of state.


Source link

These Are The Bestselling Bed Sheets That Readers Love

These Are The Bestselling Bed Sheets That Readers Love

We cover sleep a lot. We’ve done thorough research to clue readers in on the best sheets to buy, including top-selling bamboo options and those suitable for hot sleepers. And, thanks to our anonymous shopping data, we’ve noticed that there are a few sets in particular that readers can’t seem to get enough of.

Investing in a new set of sheets is a great way to improve your slumber setup at home without having to do a whole bedroom renovation. Plus, buying new bedding is a great way to end Sleep Awareness Week (yes, it’s a thing). So if you’re in the market for new sheets to cozy up in every night, look no further — we’ve rounded up seven bestselling sheets sets that our readers can’t stop buying.

BuzzFeed may collect a share of sales or other compensation from the links on this page if you decide to shop from them. All products were independently selected by editors, and the prices were accurate and items in stock at the time of publication.


Source link

GFF20 vs. COVID-19: four takeaways from Glasgow Film Festival 2020 | Sight & Sound

GFF20 vs. COVID-19: four takeaways from Glasgow Film Festival 2020 | Sight & Sound

Glasgow stays open and thriving

This year’s Glasgow Film Festival constantly faced the prospect of major disruption amidst the global outbreak of COVID-19, as major overseas events, most notably SXSW, fell to advance cancellations while this year’s GFF was still taking place. The organisers managed to pull off a complete edition before the axe fell, with the Scottish government now scaling back public gatherings in the days since its closing night. The virus has now been assigned pandemic status, and even more spring festivals in the UK and globally have since indefinitely postponed before any government intervention, including Tribeca, Belfast and the now independent Glasgow Short Film Festival.

In spite of the doom and gloom, GFF reported a new record of 43,147 attendees for screenings and events, closing on International Women’s Day with the choppy but crowd-pleasing Caitlin Moran adaptation How to Build a Girl. And a zeitgeist-capturing retrospective of dystopian films entitled Are We There Yet? proved especially popular.

 

Embrace the unknown

Body of Water (2019)Body of Water (2019)

Having stayed for all of GFF this year, I found audience numbers noticeably high even for some of the unknown quantities currently without distribution or substantial hype behind them, many having been discovered at smaller film festivals like Tallinn Black Nights rather than the more visited Toronto or Venice. The programme certainly wasn’t merely a preview of forthcoming cinema releases.

In terms of the world premieres, I was particularly taken with Roy’s World: Barry Gifford’s Chicago, Rob Christopher’s documentary on the celebrated writer that’s stylistically reminiscent of Terence Davies’ Of Time and the City. And British director Lucy Brydon’s Body of Water, exploring the ramifications of a woman’s eating disorder across her family, is a sensitive and distinctive debut feature deserving of a wider release.

 

GFF has form with facing disasters

Lost Transmissions (2019)Lost Transmissions (2019)

Lost Transmissions (2019)

This isn’t the first time the festival has faced cancellations. In 2018, thanks to Storm Emma and the cold wave christened ‘Beast from the East’, three days of GFF’s second week saw dozens of screenings, events and guest visits cancelled due to safety risks.

In comparison, just one key guest this year – Japanese voice actor Yui Ishikawa – dropping out due to travel concerns doesn’t seem so bad. And on the plus side, Simon Pegg, arguably this edition’s starriest attendee, was a last-minute addition for drama Lost Transmissions, after filming of Mission: Impossible 7 in Italy was postponed.

 

Some surprises aren’t welcome

Promising Young Woman (2020)Promising Young Woman (2020)

Promising Young Woman (2020)

The Surprise Film is always one of GFF’s hottest tickets, with the festival previously showing such transgression-baiting features as 13 Assassins and Spring Breakers. This year’s UK premiere of Promising Young Woman proved a return to shocking territory for the slot. But while Emerald Fennell’s darkly comic twist on the rape-revenge thriller went down well with most of the packed audience (and I was a fan), I’ve wondered if traditional Surprise Film introduction etiquette should have been broken to give the crowd some idea of the choice’s content, particularly given the rise in popularity of trigger warnings for screenings.

While the narrative’s inciting rape is a historical one kept offscreen, the film opens with the prolonged suggestion of an imminent sexual assault of Carey Mulligan’s seemingly incapacitated protagonist, before the eventual reveal that she has deliberately deceived the man who’s taken her to his place from a club under the guise of getting her ‘drunk’ self safely home.

Luz: The Flower of Evil (2019)Luz: The Flower of Evil (2019)

Luz: The Flower of Evil (2019)

One might argue you’re inherently consenting to potential upset with the purchase of a Surprise Film ticket. So, a more glaring example would be with Luz: The Flower of Evil, an incoherent, misogynistic western-of-sorts from Colombia, which features an extended gratuitous rape scene that lingers on the victim’s suffering. At my screening, the scene prompted at least one walkout. The brochure copy offered no forewarning of the potentially offending scene; nor did director Juan Diego Escobar Alzate and the attending programmer in their introduction – though I’m told they were challenged in the Q&A I skipped after the screening.

Later on in the festival was a fascinating industry panel on depictions of sex on-screen, which included input from on-set intimacy coordinator Yarit Dor. So, sensitivity to issues of challenging sexual content is clearly of interest to the festival. For the future, at Glasgow and at other festivals too, more care and consistency on this front would be beneficial.




Source link

Dream Interpretation: Teeth Falling Out and Its Hidden Messages

Dream Interpretation: Teeth Falling Out and Its Hidden Messages

Dreams are a window into our subconscious minds, often revealing hidden thoughts, emotions, and fears. The symbolism behind dreams about teeth falling out can vary depending on the individual’s personal experiences and beliefs. Let’s delve into some of the possible interpretations of this intriguing dream:

1. Loss of Control and Power

One interpretation of dreams about teeth falling out is that they symbolize a loss of control or power in your life. Just as teeth are essential for biting and chewing, they can represent our ability to assert ourselves and navigate the world. If you feel overwhelmed or helpless in certain areas of your life, this dream may be a manifestation of those emotions.

2. Communication Issues

Teeth are also associated with communication, as they play a crucial role in speech. Dreams about teeth falling out may reflect difficulties in expressing yourself or feeling misunderstood in your waking life. Consider whether there have been recent conflicts or challenges in your communication with others.

3. Anxiety and Stress

Dreams about teeth falling out are often linked to feelings of anxiety and stress. These dreams may arise during times of heightened pressure or uncertainty, such as significant life changes or challenging situations. Pay attention to the emotions evoked by the dream and explore whether there are underlying sources of stress in your life that need to be addressed.

4. Self-Esteem and Confidence

Teeth are visible when we smile or speak, and they can influence our self-image and confidence. Dreams about teeth falling out may indicate insecurities or concerns about how others perceive you. Reflect on any areas of your life where you may be experiencing self-doubt or a lack of confidence.

5. Fear of Aging and Mortality

As we age, our teeth naturally undergo changes. Dreams about teeth falling out can reflect anxieties about the aging process and mortality. These dreams may arise during transitional periods in life or when contemplating the passage of time. Take time to reflect on your feelings about aging and consider how you can embrace the wisdom and experiences that come with it.


Source link

Access Denied


Access Denied

You don’t have permission to access “http://www.business-standard.com/companies/results/infosys-q2-results-net-profit-rises-4-7-to-rs-6-506-cr-revenue-up-5-124101700877_1.html” on this server.

Reference #18.10ea4217.1729209874.19cd14cc

https://errors.edgesuite.net/18.10ea4217.1729209874.19cd14cc


Source link

Shop my Amazon Must-haves! – Sincerely Jules

I’m always on the lookout for new pieces to refresh my wardrobe, home, and everyday essentials to keep me inspired and energized. If you’re feeling stuck or just want to bring fresh energy into your space, I’ve got you covered. I’ve curated a list of items you can easily find on Amazon, including some of my favorite must-haves! Whether it’s the exact item or a similar one, these picks reflect what I’m loving right now—from beauty essentials to everyday gadgets and home goods. I hope these items spark some inspiration and new ideas for you! Shop here

xx Jules

Keep scrolling to see more!


Source link

How a 12-Ounce Layer of Foam Changed the NFL

How a 12-Ounce Layer of Foam Changed the NFL

Late in his team’s game against the Green Bay Packers on September 15, Indianapolis Colts tight end Kylen Granson caught a short pass over the middle of the field, charged forward, and lowered his body to brace for contact. The side of his helmet smacked the face mask of linebacker Quay Walker, and the back of it whacked the ground as Walker wrestled him down. Rising to his feet after the 9-yard gain, Granson tossed the football to an official and returned to the line of scrimmage for the next snap.

Aside from it being his first reception of the 2024 National Football League season, this otherwise ordinary play was only noteworthy because of what Granson was wearing at the time of the hit: a 12-ounce, foam-padded, protective helmet covering called a Guardian Cap.

Already mandatory for most positions at all NFL preseason practices, as well as regular-season and postseason practices with contact, these soft shells received another vote of confidence this year when the league greenlit them for optional game use, citing a roughly 50 percent drop in training camp concussions since their official 2022 debut. Through six weeks of action this fall, only 10 NFL players had actually taken the field with one on, according to a league spokesperson. But the decision was easy for Granson, who tried out his gameday Guardian Cap—itself covered by a 1-ounce pinnie with the Colts logo to simulate the design of the helmet underneath—in preseason games before committing to wear it for real.

“I was pleasantly surprised that it didn’t affect anything for me,” the 26-year-old told WIRED a few days before facing the Packers in week two. “I thought, even if it looks kind of silly, it’s worth it.”

There is no ignoring the goofy aesthetics of the puffy, blobby Guardian Caps. The product’s parent company, Guardian Sports, even has staff T-shirts that declare, LOOK GOOD, FEEL GOOD, PLAY GOOD—with LOOK GOOD crossed out. “Condom caps, mushroom heads—we’ve heard them all,” says Erin Hanson, cofounder of Guardian Sports alongside her husband, Lee Hanson. “We just laugh, because we agree.”

It can be tough to square the reality that the apparent future of football headgear resembles something out of a ’60s-era sci-fi movie. But the fact that Guardian Caps are now allowed at all in games in the NFL—a league known for policing every inch of player equipment to protect its image—doesn’t just speak to their lab-tested utility (even if published, peer-reviewed on-field data remains lacking). It also reflects the urgency of the moment for football at large.

The dangers of strapping on a helmet have never been clearer, given the link between repeated blows to the head—whether concussion-causing or not—and chronic traumatic encephalopathy (otherwise known as CTE, a brain disorder associated with cognitive issues like depression and progressive dementia that can only be diagnosed posthumously). Not coincidentally, the race to find answers has become faster and more lucrative than ever, between the NFL’s funding of private research efforts and a rapidly innovating football headgear industry.

And at the center of it all, on the sport’s biggest stage, is a literal mom-and-pop shop that, less than a decade and a half ago, was struggling to find a foothold in football as anything but a joke.


Source link

Anker Recalls Another Three Battery Power Banks for Fire and Explosion Hazard

Anker Recalls Another Three Battery Power Banks for Fire and Explosion Hazard

Anker is recalling three of its portable battery banks, after some of them exploded and caught on fire. If you have one of the affected batteries, you should stop using it and return it to Anker.


These power banks are typically used to recharge other portable devices, such as cell phones, tablets, watches, and laptops, and range from 12W to 20W. They’re readily identifiable by the Anker logo engraved on the front of the bank along with the model number on the back and are labeled as, “Anker 334 MagGo Battery (PowerCore 10K)/Anker Power Bank/Anker MagGo Power Bank, Model: A1642/A1647/A1652,” according to the recall notice. The impacted devices were reportedly manufactured between January 3, 2024 and September 17, 2024, with model numbers A1642, A1647, and A1652.


Anker has received more than two dozen complaints about the batteries overheating, explode, and even catch on fire. Two people have been reported injured by the banks to date, causing first and second degree burns to the victims’ hands.

Anker batteries impacted by recall.
Anker


You should immediately stop using the recalled power banks and reach out to the company for a free replacement. You can do that by going to the Anker Recall website, scroll partway down the screen and enter the serial number from the back or bottom of the device to confirm whether it is impacted by the recall. Anker is also quick to point out that you shouldn’t just dump the recalled device in the trash, where it can potentially start a fire, but should rather dispose of it responsibly at a facility that accepts lithium-ion batteries.

Unfortunately, this isn’t the first time, even this year, that Anker has had to issue a recall order for its faulty products. The company was forced to temporarily pull three more models (A1642, A1647, and A1652) off the market in September due to their likelihood to overheat, melt, and catch on fire.

Source: Anker, CPSC


Source link

Access Denied


Access Denied

You don’t have permission to access “http://www.business-standard.com/companies/news/india-to-rise-to-skyscanner-s-top-3-revenue-markets-ceo-mangelaars-124101701388_1.html” on this server.

Reference #18.77cfdb17.1729199847.8387084c

https://errors.edgesuite.net/18.77cfdb17.1729199847.8387084c


Source link