Microsoft's Billion-Dollar AI Upgrade for Excel: Revolutionizing Spreadsheets

Excel's AI Makeover: Microsoft's Billion-Dollar Bet on Smarter Spreadsheets

In the race to infuse artificial intelligence (AI) into every corner of the digital world, Microsoft has set its sights on conquering the final frontier of office productivity: the humble spreadsheet. The tech giant's latest creation, SpreadsheetLLM, aims to change how businesses crunch numbers and make decisions. By harnessing the power of large language models (LLMs), this AI tool, which is still in the testing stages, could transform Excel from a static grid into a dynamic, question-answering powerhouse -- potentially reshaping workflows for millions of users worldwide. "The infinite cell-like nature and references to cells in spreadsheets make it challenging for LLMs, which have been trained using standard linear tokenization techniques, to understand the spreadsheet data model," Rogers Jeffrey Leo John, co-founder and CTO of DataChat, a no-code, generative AI platform, told PYMNTS. At the heart of SpreadsheetLLM lies SheetCompressor, an encoding framework that effectively compresses spreadsheets for use by LLMs. This breakthrough, detailed in a study on the arXiv preprint server, tackles a longstanding challenge in applying AI to spreadsheets. Microsoft's SheetCompressor, uses three clever tricks to shrink spreadsheets for AI use. First, it spots and compresses repetitive data. Next, it converts information to a format (JSON) without losing details. Finally, it bundles data together with matching formats. The results are impressive. SheetCompressor cuts down the AI's workload by 96%. This could mean businesses pay just 1/25th of what they would otherwise for AI to crunch their spreadsheet numbers. Of course, AI is already useful for manipulating spreadsheets. Microsoft's Excel Ideas feature uses AI to analyze data and suggest visualizations, charts and pivot tables. Users can simply select a range of data and ask Excel to recommend insights, streamlining the process of identifying trends and patterns. Google Sheets has introduced Smart Fill, which uses AI to detect patterns in data entry and automatically suggests column completions. This feature saves time on repetitive data input tasks and helps maintain consistency across large datasets. Startups like Rows and Causal are building AI-native spreadsheet alternatives. Rows, for instance, allows users to pull data from various sources using natural language queries, while Causal focuses on financial modeling with AI-assisted forecasting. Tiller Money leverages AI to categorize financial transactions automatically in spreadsheets, helping users track expenses and budgets more effectively. The system learns from user corrections to improve accuracy over time. Spreadsheet.com incorporates AI to suggest formulas and functions based on a sheet's data and column headers. It can also generate charts and graphs automatically when users select data ranges. Airtable's AI assistant can help users create new tables, suggest field types, and even write formulas based on natural language descriptions of what the user wants to achieve. Microsoft's team tested SpreadsheetLLM against proprietary models like GPT-3.5 and GPT-4 and open-source offerings like Llama 2, Llama 3, Phi-3, and Mistral-v2. The results were impressive, with GPT-4 showing a 27% improvement in table detection compared to previous methods. The researchers have also introduced a chain of spreadsheet (CoS) methodology, further refining the AI's ability to work with spreadsheet data by breaking tasks into manageable steps for the models. The implications for businesses could be far-reaching. With its massive user base, Excel has long been a cornerstone of Microsoft's Office suite and a crucial tool across industries. The company aims to enhance spreadsheet functionality by integrating AI capabilities, potentially automating complex tasks, and offering new data interpretation methods. "SpreadsheetLLM has the potential to transform data analysis in spreadsheets by enabling efficient user interactions and more accurate responses to plain English questions on spreadsheet data," John said. However, the technology is not without limitations. Due to token constraints, the framework doesn't account for visual elements like background colors and borders. The researchers also acknowledge that more work is needed in semantic understanding of cell contents. While direct integration of SpreadsheetLLM into Microsoft Excel isn't imminent, the research signals a clear direction for future feature enhancements. The potential to dramatically improve data analysis and spreadsheet insight generation could lead to time savings and new data-driven discoveries for businesses. The technology could have broader implications for how businesses leverage their data assets. "With technologies like SpreadsheetLLM that provide ways of encoding the knowledge present in spreadsheets to LLMs, business users will now be able to leverage GenAI technologies to combine information from their spreadsheets and data warehouses to make more efficient business decisions," John predicted.

Your Microsoft Excel spreadsheets could soon have a lot more AI power

Microsoft researchers have unveiled a large language model with the ability to enhance the interaction with and understanding of spreadsheets has been introduced, marking a significant leap forward for AI's ability to handle Excel files. Outlined in a paper, entitled 'SpeadsheetLLM: Encoding Spreadsheets for Large Language Models,' the team looks to explore the complexities and challenges of applying AI to structured, logical and formulaic datasets. SpreadsheetLLM promises the ability to combine these datasets with the already proven capabilities of large language models. According to the researchers, "SpreadsheetLLM is an approach for encoding spreadsheet contents into a format that can be used with large language models (LLMs) and allows these models to reason over spreadsheet contents." The research notes the widespread use of spreadsheets in various business operations, from simple data entry to complex financial modelling. However, despite the importance of these numerical files, existing LLMs have struggled to structure the data and formulas. By encoding the data in a package that LLMs can comprehend, Microsoft's researchers hope to unlock the processing power of current generative AI tools that use existing LLMs within the Excel environment. By unlocking the full potential of spreadsheet data, businesses using generative AI tools could improve their data-based decision-making and improve the efficiency of other administrative tasks. Although SpreadsheetLLM is currently little more than a research project, the work to improve compatibility between Excel files and existing AI tools does at least signify the continually evolving power of AI. Moreover, while the company has not yet committed to building such a tool on a wider scale, Microsoft's multibillion-dollar investment in ChatGPT maker OpenAI and its subsequent rollout of generative AI functionalities across its office apps implies that the tech giant is committed to making AI more accessible.

Even AI struggles to understand Excel sheets - Microsoft swoops in to help

SpreadsheetLLM turns spreadsheets into bite-sized chunks that LLMs can handle If sifting through Excel spreadsheets isn't your thing and you'd rather have an AI chatbot make sense of all the rows and columns for you, Microsoft may hold the key to helping LLMs understand spreadsheets better. It's not just you, AI is also known to struggle with processing spreadsheets. Their expansive grids and various cell formats act as hurdles that LLMs must overcome. Now, a group of Microsoft researchers think they may have found a solution that optimizes LLMs' approach to deciphering spreadsheets. In a pre-print paper submitted on July 12, the researchers unveiled SpreadsheetLLM, a new method that combines encoding and compression with leading AI chatbots to help them handle spreadsheets more efficiently. Their data suggests using their method, the GPT4 AI model improved by 27% in terms of spreadsheet table detection and by nearly 26% in performance on in-context learning. Their method also led to cost reductions of up to 96% based on GPT4 and GPT3.5-turbo prices. A version of this could be integrated into Microsoft Copilot for 365 in the future, making it easier than ever to make sense of data. The key to SpreadsheetLLM's success is Microsoft's SheetCompressor, an encoding framework that compresses spreadsheets effectively for LLMs. It comes with three different modules: one that makes spreadsheets more legible for LLMs, another that bypasses empty cells and repeating numbers, and another module that helps LLMs better understand what a number means (like if it's a year or a phone number). This compression method reduced token usage for spreadsheet encoding by 96%. Their compression method significantly boosted performance on larger spreadsheets, where the challenges of high token usage are felt the most. In their paper, the authors also said they created "Chain of Spreadsheet", a framework extender that helps identify the table relevant to a question and determines the boundaries of the relevant content. The question and the data are then presented again to the LLM which then processes the trimmed information to generate a response. Directly inputting a typical spreadsheet often meant the token limits of conventional models simply got exceeded. The Chain of Spreadsheet method helped LLMs focus only on regions relevant to the questions posed, reducing unnecessary data, thus keeping the LLM efficient. One limitation that the Microsoft researchers pointed out about their current method was that it can't yet handle spreadsheet formatting details such as background color and borders since this information costs too many tokens. While this won't immediately mean much for the average user, if newer versions of chatbots such as ChatGPT and Claude incorporate Microsoft's SpreadsheetLLM, we may soon be able to upload entire spreadsheets and ask the chatbots questions in plain language to receive data summaries or analysis based on the file we uploaded.