Turbocharge Dialogflow Chatbots With LLMs and RAG
Are Dialogflow chatbots still relevant when LLM-based chatbots are available? Yes. We'll show you how you can combine them to get the best of both worlds.
The landscape for using AI in ecommerce and the retail industry has changed a lot recently. Some of the most popular products and approaches have been compromised or undermined in a very short time by a new global impetus for privacy reform, and by the way that the COVID-19 pandemic has transformed the nature of retail.
These events have thrown a huge spoke in the long-term plans of both the AI in ecommerce industry and the forecasting sector alike. The previous surge of interest in facial recognition systems for retail has given way to a focus on improving the online shopping experience, leveraging AI-driven predictive analytics, and improving the management and configuration of bricks-and-mortar stores.
In the meantime, the continuity of market forecasting models has been catastrophically disrupted by a transformed business environment. With a massive increase in ecommerce sales under COVID-19, there's no doubt that huge growth in the use of artificial intelligence for ecommerce companies and online retailers is coming – but it may not be in the sectors that were anticipated just 12 months ago.
So what can we depend upon, going forward? Here are four baseline approaches to AI in ecommerce that are likely to prove resistant to the current volatile market.
A better understanding of product relationships and customer intent can transform turnover and conversion, and a really effective AI-driven inventory search system will stand out in a sector that's developed a bad reputation in recent years.
For instance, it's a common complaint that if you buy — for instance — a TV, the site you bought it from might follow up with product recommendations for non-sequitur purchases such as:
In an ideal world, you're going to need better search logic (and possibly better data) than that.
As the above examples demonstrate, the key to a successful recommender system lies not in merely finding relationships between data points and events, but in identifying associations, hidden in different strands of the data, that are both meaningful and incentivizing for the customer.
The process of developing an effective recommender system with ai technology requires a lot of initial curation, an open mind, and a willingness to experiment. A/B testing can help establish recommended weights, while offline A/B testing is another useful tool for developing optimal parameters and settings for an ecommerce product recommender algorithm.
If a single customer buys a TV and a box of chocolates in the same purchase, most supervised learning approaches will dismiss the event as an 'outlier' anomaly. Perhaps the customer was, by coincidence, buying a gift at the same time as a typical domestic fixture. Perhaps they were feeling a bit down. Who knows?
If two or more apparently unrelated customers were to place the same two items — or item types — in an order, a typical artificial intelligence framework might identify an implicit association between TV/Box Of Chocolates, and later present either as an after-market recommendation to customers who purchased the 'correlated' item.
But the system might fail to notice that the original orders were placed in the second week of February — the second-highest seasonal driver for chocolate sales.
Will the algorithm continue to associate the items throughout the summer and fall? Or will it recognize that the association is specious outside of the Easter and Valentine's Day surges, and that there is no intrinsic 'relationship' between the two items at all?
As we can see, some of the relevant data and insights necessary for an effective recommendation system will not be present in a typical customer relationship management (CRM) database, or in conventional sales analytics systems.
It's here that the deployment of machine learning analysis can really help in filtering out the noise of coincidence from the discovery of useful and exploitable data relationships.
In cases where the customer is viewing your commercial environment from a dedicated mobile app in a device with client-side neural network capabilities, it's possible to deliver truly customer-specific results, by updating the local search algorithm, and assigning dedicated weights to the customer.
In these circumstances, the algorithm can operate with almost zero latency, even for time-critical functions such as text prediction.
In a less accommodating web environment, customer inference and intent can still be fueled by targeted AI-driven analytics, depending on the server-side resources that are available for updating models for individual clients.
What do you do if you have no historical data yet, or if the customer is so new that a 'generalized' search algorithm might leave them with sub-standard matches?
One US startup grew nearly 400% in a year by using artificial intelligence to analyze its own first-party data for product engagement and platform usage metrics. In this way it was possible to develop a 'fictional' historical sales database that could be improved and refined by real-world transactions.
Research out of Harvard also recently proposed a 'First Impression Model' (FIM) capable of forecasting a customer's underlying traits and lifetime value using only the minimal information from their earliest transactions and interactions. The framework uses a probabilistic machine learning approach to feed forecast accuracy reports about new customers into the improvement of the technique over time.
In a retail setting, insights from the FIM model revealed:
The automation of useful insights like this through artificial intelligence is a recent phenomenon, due in part to the advent of GPU-based AI acceleration since 2010.
However, the analytics and forecasting marketplace remains dominated by legacy systems that apply 'static' theoretical models to real-time data, rather than the new wave of artificial intelligence approaches that are capable of suggesting entirely new sales flow models, architectures and core principles.
Sometimes the data will not bend to the theory, and only machine learning can dynamically address this. Even fairly recent analytics luminaries such as Hadoop and Apache Spark are now ceding ground to TensorFlow, and to the rise in more flexible neural networks.
This is the ideal time to integrate ai solutions into product search, because:
The advent of the COVID-19 pandemic greatly accelerated, uptake of Ai-enabled chatbots across all industries and in the public sector. Consequently the chatbot sector is currently estimated to rise from its current value of $2.6 billion USD to $9.4 billion by 2024, a compound annual growth rate (CAGR) of 29.7%.
Some of the many sectors that have increased use cases for AI-centered chatbots since the outbreak include:
Examples of innovative chatbots include:
In 2020 Microsoft acquired exclusive licensing rights for OpenAI's revolutionary GPT-3 text-generation system, which had already astonished the tech press, with its insight and capability earlier in the year, and which can operate as a chatbot if required.
It's been argued that GPT-3 finally demonstrates that a generalized knowledge system can conduct useful and informative discourse without needing to be trained with domain-specific datasets, or years of historical customer interactions.
Though it isn't yet a perfect conversational partner, GPT-3 does demonstrate the rise in public confidence and expectations for AI discourse agents over the next five years.
Companies and individuals licensing GPT-3 are using it for purposes as diverse as Python code generation, resume building, content generation and chat response automation. This indicates that chatbot deployments may, in the future, represent only one utilization of a central business-focused AI system.
Facebook's own research into 'open domain' chatbots such as GPT-3 indicates that the near future will remain dominated by domain-specific AI agents, powered by insights from a company's own customer data.
Therefore the immediate value of chatbot development lies in leveraging historical (proprietary) data to ensure apposite responses in areas such as:
The shopping experience is becoming noticeably more driven by data and ai enabled algorithms, with computer vision a crucial element in a new ecommerce & online retailers revolution.
The general global image recognition market is set to rise from $30.28 Billion USD in 2020 to $98.47 Billion by 2027, while the retail sector alone is estimated to rise from $1.4 billion USD to $3.7 billion by 2025.
Additionally, Gartner has forecast that by 2022 70% of retail interactions will involve ai solutions and their ancillary technologies.
In the current 'masked' age, the locus of AI research and investment has shifted from in-store facial recognition to image-based analysis of stock items in a retail context:
Image recognition can also help in evaluating how paid influencer campaigns are disseminating images of your product (through image recognition), and in gauging the type of responses that the product is creating (through NLP and associated techniques).
Though the need for customers to wear masks has impacted the usefulness of facial recognition in retail, computer vision can be deployed in various ways in a store without requiring facial identification:
You might be looking forward to running your historical customer data or site traffic statistics through a neural network in order to:
However, nearly all of these activities are made possible by tracking methods that are increasingly coming up for legislative review around the world, or else being suppressed by the makers of the most popular web-browsers and manufacturers of mobile devices.
The major technology in decline is cross-domain tracking. The past five years of scandals around AI-enabled political social engineering have brought the use of supercookies and other 'omniscient' web tracking techniques far enough into the public consciousness to effect real change:
The message here is that the 'wild west' era of populating ecommerce datasets with cross-tracked data is coming to an end,.
In this transitional period, it's unclear whether the new generation of privacy-focused frameworks — such as Google's Privacy Sandbox initiative, LiveRamp's Authenticated Traffic Solution, and offerings from Neustar and Project Rearc, — may eventually fall foul of later privacy initiatives.
Therefore it's prudent to:
The restrictions that come with a growing emphasis on privacy, and with the privations of the pandemic, are also unique opportunities for using artificial intelligence in ecommerce and online retail space to continue to grow.
The massive growth of consumer data under coronavirus restrictions has led to a corresponding boom in the Big Data Analytics (BDA) sector, leading in turn to an unexpected acceleration in machine-driven analytics that most believe is here to stay.
In the meantime, the prospect of well-defined privacy laws promises, at last, a stable legal environment and a relatively level playing field for ecommerce analytics and artificial intelligence systems, furnishing the business confidence necessary to invest in a new generation of compliant and performant AI-driven analysis frameworks.
Interested in seeing what Ai models can do for your ecommerce business? Want to start collecting data that gives you ROI your competition would beg to have? Let's talk about how we can use Ai to increase conversions and find potential high value customers hiding in plain site.
Contact us to learn more
Don't let your niche competitors find these Ai models first.