The Most Disruptive Technology Since the Internet
ChatGPT revolutionized the market when it launched in late 2022, prompting Microsoft to quickly integrate ChatGPT’s capabilities across its software ecosystem. Other tech giants, caught off guard, raced to catch up. Google launched Bard, while AWS introduced Bedrock, enabling users to customize LLMs for their specific needs.
The LLM space is evolving rapidly, offering unprecedented opportunities for innovation.
While ChatGPT unlocked immense productivity, many companies banned its use due to concerns over exposing confidential information. To address this, Tony leveraged AWS Bedrock to build a secure, internal-only chat bot using Anthropic’s Claude 2 model.
He developed a user interface with Python Dash, incorporating customization toggles for the chat engine and enabling seamless back-and-forth interaction with the model. This solution gave internal teams access to cutting-edge LLM technology in a secure, isolated environment, boosting productivity while safeguarding sensitive data.
When they first launched, many chat bots restricted users from uploading documents to minimize costs. Tony addressed this limitation by creating an externally facing LLM that allowed users to upload PDF, Word, and text files as part of their prompts. (This tool has since been deprecated).
To further democratize this capability, Tony published a blog post with detailed instructions on replicating the setup, enabling others to build similar tools for their own needs.