Tags: #DataEngineering #AI #Python #HuggingFace #Streamlit
For decades, SQL has been the universal language for extracting insights from databases. But there's a catch: it creates a bottleneck. Business analysts, product managers, and marketers often have to wait for data teams to write queries for them.
What if we could skip the code and just talk to our databases in plain English?
Thanks to the rapid advancements in Artificial Intelligence and Large Language Models (LLMs), this is now entirely possible. Today, I'll walk you through how I built a Text-to-SQL assistant using Python, and how you can do it too.
At its core, Text-to-SQL is an AI capability that translates conversational questions into executable SQL code. Imagine typing, "Show me all employees in the Sales department earning over 50k" and having the AI instantly generate:
SELECT * FROM employees WHERE Department = 'Sales' AND Salary > 50000;
It’s like having a senior data engineer at your fingertips 24/7.
To keep things simple and accessible, I chose a modern, lightweight stack for this project:
t5-base-finetuned-wikiSQL
).Instead of training a model from scratch, we leverage Hugging Face's Inference API. By sending an HTTP request with our user's question, the API returns the translated SQL query. It's incredibly fast and requires very little code:
import requests
API_URL = "https://api-inference.huggingface.co/models/mrm8488/t5-base-finetuned-wikiSQL"
def get_sql_from_text(user_query):
payload = {"inputs": f"translate English to SQL: {user_query}"}
response = requests.post(API_URL, json=payload)
return response.json()[0]['generated_text']
For demonstration purposes, the app initializes an in-memory SQLite database loaded with some dummy employee records. This allows the app to actually execute the AI-generated SQL and prove that it works, rather than just showing the query on the screen.
Streamlit ties everything beautifully. We capture the user's input through a text box. When they hit "Generate", the app fetches the SQL from Hugging Face, executes it against our SQLite database using pandas.read_sql_query
, and renders the final dataset directly in the browser.
Tools like this represent a massive shift in data democratization. When you remove the technical barrier of SQL, you empower everyone in an organization to be data-driven, speeding up decision-making across the board.
Want to see the code in action or try running it yourself?
I've made the entire project open-source. Check out my repository here:
👉 https://github.com/FabricioRams/Research-Team-Work-N-01-SQL-AI-Database-Solutions.git
(Note: Just install the requirements and run streamlit run app.py to start chatting with your data!)