Give your LangGraph agent real-time web data with Apify

Apify released an official LangChain integration, langchain-apify, that gives LangGraph agents access to real-time web data through 19 dedicated tools split across APIFY_CORE_TOOLS, APIFY_SEARCH_TOOLS, and APIFY_SOCIAL_TOOLS, plus an ApifyActorsTool for running any other Actor. The company also offers the Apify MCP Server at mcp.apify.com, which exposes thousands of Apify Actors as tools over the Model Context Protocol with stdio support via @apify/actors-mcp-server and Streamable HTTP, and OAuth or API token authentication. Setup requires Python 3.10+, an Apify account, and an OpenAI API key, with libraries installed via pip install langchain langchain-openai langchain-apify python-dotenv.

The usefulness of a LangGraph agent workflow largely depends on the quality and scope of the tools it can access. Apify extends LangGraph agents with real-time web data. In this tutorial, you'll learn how to connect LangGraph to Apify through the official LangChain integration and via MCP. Apify support for LangGraph Apify https://apify.com/ is a marketplace of ready-to-run tools for AI. It provides tools for accessing web data and automating tasks such as web search, social media monitoring, lead generation, e-commerce data extraction, and more https://apify.com/use-cases . At the core of Apify are Actors https://apify.com/actors , serverless programs that perform specific tasks, such as scraping websites, running browser automation, or powering AI workflows. LangGraph agents can use Apify Actors in two main ways: 1. Through the official langchain-apify https://github.com/apify/langchain-apify integration. 2. Via Apify MCP Server. Official Apify LangGraph integration The Apify LangGraph integration https://docs.apify.com/integrations/langgraph provides LangChain-compatible tools that wrap specific Actors behind simplified input schemas. This way, LangGraph agents can call Actors without needing to know the underlying input schema. langchain-apify provides 19 dedicated tools https://docs.apify.com/integrations/langchain choose-the-right-tool-set across three categories: - APIFY CORE TOOLS : for running Actors and tasks, scraping URLs, and retrieving dataset items - APIFY SEARCH TOOLS : for web search, crawling, maps, YouTube, and e-commerce data - APIFY SOCIAL TOOLS : for platforms such as Instagram, LinkedIn, TikTok, Facebook, and X You can give an agent individual tools, an entire tool bundle, or use ApifyActorsTool https://docs.apify.com/integrations/langchain run-any-other-actor to run an Actor that doesn’t have a dedicated tool. Apify MCP Server with LangGraph Apify MCP Server https://mcp.apify.com/ provides a programmatic interface for AI agents to discover and use Apify tools through the Model Context Protocol. It exposes thousands of Apify Actors as tools, allowing an agent to discover and use Actors on the fly. The MCP server provides tools https://docs.apify.com/integrations/mcp for: - Actor discovery : search Apify Store and retrieve Actor details and schemas - Actor execution : run Actors and retrieve their results - Web access : call tools for web scraping, such as RAG Web Browser https://apify.com/apify/rag-web-browser and Web Fetch https://apify.com/apify/web-fetch - Storage : access datasets generated by Actor runs - Documentation : search and retrieve Apify documentation - Tasks and schedules : manage saved Actor tasks and scheduled runs The server supports stdio via @apify/actors-mcp-server https://www.npmjs.com/package/@apify/actors-mcp-server as well as Streamable HTTP. Supported authentication methods include OAuth and API token. Common setup steps Before getting started with the LangGraph + Apify integration, whether via the official integration or MCP, you need to complete a few common tasks first. Prerequisites Make sure you have: - Python 3.10+ installed locally https://www.python.org/downloads/ , with a project and an activated virtual environment https://docs.python.org/3/library/venv.html - An Apify account https://console.apify.com/sign-up - An OpenAI API key https://platform.openai.com/api-keys Basic knowledge of the following topics will also be useful: Step 1: Install the libraries In your Python project, with the virtual environment activated, run: pip install langchain langchain-openai langchain-apify python-dotenv This installs the required dependencies: - langchain https://pypi.org/project/langchain/ : For crafting LangGraph agents via LangChain - langchain-openai https://pypi.org/project/langchain-openai/ : To use OpenAI models with LangChain agents - langchain-apify https://pypi.org/project/langchain-apify/ : To connect your LangGraph agent workflow to Apify - python-dotenv https://pypi.org/project/python-dotenv/ : For loading API keys from a .env file Note : You don’t need to install langgraph https://pypi.org/project/langgraph/ separately for this example. The langchain package installs langgraph as a dependency, as its high-level API helps you build LangGraph agents https://docs.langchain.com/oss/python/langchain/overview . Step 2: Retrieve the Apify API key Both langchain-apify and the Apify MCP server can use an Apify API token https://docs.apify.com/api/v2 authentication for authentication. To get your API token: 1. Log in to Apify Console https://console.apify.com/ 2. Go to Settings API & Integrations 3. In the API tokens section, copy your token using the “copy to clipboard” button Store your API token securely. You'll need it in the next steps. Note : Apify MCP Server supports agentic payments via AGI, direct x402, or Skyfire https://github.com/apify/apify-mcp-server -agentic-payments , so that you can pay for Actor runs without an Apify API token. Step 3: Configure environment variables Your LangGraph agent workflow relies on Apify and OpenAI, so you must provide an Apify API token and an OpenAI API key. Never hardcode API keys in your source code. Store them as environment variables instead. Create a .env file in your project directory and populate it with: OPENAI API KEY="<YOUR OPENAI API KEY " APIFY TOKEN="<YOUR APIFY TOKEN " Replace <YOUR OPENAI API KEY and <YOUR APIFY TOKEN with your actual OpenAI API key and Apify API token. To load these variables from the .env file, import load dotenv from python-dotenv and call it at the beginning of your Python file: python from dotenv import load dotenv Load API keys from .env load dotenv You don't need to load the API keys manually in your agent code. langchain-openai reads OPENAI API KEY , and langchain-apify reads APIFY TOKEN from the environment automatically. How to build a LangGraph agent workflow with Apify In this guided section, you'll see how to create a LangGraph agent that uses Apify LangChain tools for web search, social media data extraction, and more. Step 4: Configure the AI model Use langchain-openai to configure the OpenAI model that your LangGraph agent will use: python from langchain openai import ChatOpenAI Define the OpenAI model that will serve as the agent's brain model = ChatOpenAI model="gpt-5.4-mini" This sets gpt-5.4-mini https://developers.openai.com/api/docs/models/gpt-5.4-mini , but you can replace it with another OpenAI model based on your requirements. If you prefer to use a different model provider, see the LangChain documentation for integrations with Anthropic https://docs.langchain.com/oss/python/integrations/providers/anthropic , Google https://docs.langchain.com/oss/python/integrations/providers/google , or other providers. Step 5: Import the Apify LangChain tools Begin by importing the desired tool sets from langchain-apify : python from langchain apify import APIFY SEARCH TOOLS, APIFY SOCIAL TOOLS, This gives you access to the Apify search 6 tools and social 7 tools tool bundles. To get the Apify tools ready for LangGraph, you first need to instantiate each tool class: tools = tool cls for tool cls in APIFY SEARCH TOOLS + APIFY SOCIAL TOOLS The above line loops through the tool classes in both sets, creates an instance of each class, and stores them in the tools list. Alternatively, when you need granular control, you can import individual tools: python from langchain apify import ApifyRAGWebBrowserTool, ApifyLinkedInProfileDetailTool, ... Then, instantiate the tools you want to use: browser = ApifyRAGWebBrowserTool linkedin = ApifyLinkedInProfileDetailTool tools = browser, linkedin Step 6: Define the LangGraph agent Add a system prompt that tells the agent its role and how to behave: agent system prompt = "You are a helpful research assistant. Use Apify tools when you need to " "fetch web or social media data." Next, create the LangGraph agent by using the model, tools, and system prompt: python from langchain.agents import create agent Create the LangGraph agent with the configured model, tools, and system prompt. agent = create agent model=model, tools=tools, system prompt=agent system prompt, create agent https://reference.langchain.com/python/langchain/agents/factory/create agent is the standard API for creating agents in LangChain v1.0+ https://docs.langchain.com/oss/python/releases/langchain-v1 . It provides a high-level interface for building agents with LangGraph and replaces the now-deprecated langgraph.prebuilt.create react agent https://reference.langchain.com/python/langchain-classic/agents/react/agent/create react agent API. agent now stores a LangGraph ReAct agent, which can reason about a task, call tools, observe their results, and iterate until it can provide an answer. Step 7: Run the agent To verify that the agent can use the Apify tools for web search and social media data retrieval, define a test prompt like this: user prompt = "Research Nike's social media presence on TikTok, LinkedIn, and Facebook.\n" "For each platform, retrieve the available profile information and recent relevant data. " "Return a report summarizing the key information, including the profile URL, " "follower count, and other relevant metrics." Pass the prompt to the agent and stream its execution: for update in agent.stream { "messages": { "role": "user", "content": user prompt, } }, stream mode="updates", : for node name, node update in update.items : print f"\n{'=' 20} {node name} {'=' 20}" if "messages" not in node update: continue for message in node update "messages" : message.pretty print This lets you see the agent's responses, including the tool calls it makes and their results. Step 8: Put it all together This is the final Python script for your LangGraph agent workflow with Apify tools: pip install langchain langchain-apify langchain-openai python-dotenv from dotenv import load dotenv from langchain apify import APIFY SEARCH TOOLS, APIFY SOCIAL TOOLS, from langchain openai import ChatOpenAI from langchain.agents import create agent Load API keys from .env load dotenv Turn the Apify tool sets into LangGraph-ready tools tools = tool cls for tool cls in APIFY SEARCH TOOLS + APIFY SOCIAL TOOLS Define the OpenAI model that will serve as the agent's brain model = ChatOpenAI model="gpt-5.4-mini" Specify the instructions that guide the agent's behavior agent system prompt = "You are a helpful research assistant. Use Apify tools when you need to " "fetch web or social media data." Create the LangGraph agent agent = create agent model=model, tools=tools, system prompt=agent system prompt, Specify the agent's task user prompt = "Research Nike's social media presence on TikTok, LinkedIn, and Facebook.\n" "For each platform, retrieve the available profile information and recent relevant data. " "Return a report summarizing the key information, including the profile URL, " "follower count, and other relevant metrics." Stream the agent execution, including tool calls and results for update in agent.stream { "messages": { "role": "user", "content": user prompt, } }, stream mode="updates", : for node name, node update in update.items : print f"\n{'=' 20} {node name} {'=' 20}" if "messages" not in node update: continue for message in node update "messages" : message.pretty print Run the script. The agent's output will be streamed to the terminal. Before the agent's final response, you'll see the individual steps it takes, including the Apify tools it calls: In this case, the agent called these Apify tools: - apify tiktok scraper wraps TikTok Scraper https://apify.com/clockworks/tiktok-scraper - apify linkedin profile search wraps LinkedIn Profile Search Scraper https://apify.com/harvestapi/linkedin-profile-search - apify facebook posts scraper wraps Facebook Posts Scraper https://apify.com/apify/facebook-posts-scraper For each tool call, you'll see the data returned by the tool: The agent uses the returned data to generate a contextual response, such as the following: Note how the final response includes real-world social media URLs and other platform-specific metrics. This demonstrates that the LangGraph + Apify agent workflow worked as expected. How to set up MCP LangGraph integration with Apify MCP Server Below, you'll learn how to connect a LangGraph agent to Apify MCP Server https://mcp.apify.com/ and give it access to the full range of tools available on Apify Store. Step 4: Add the required library Begin by adding a required dependency: pip install "langchain mcp " "langchain\ mcp\ " fully replaces the old langchain-mcp-adapters https://docs.langchain.com/oss/python/migrate/langchain-mcp-adapters , letting you connect your LangGraph agent to MCP servers and use their tools with LangChain. Because MCP tool loading is asynchronous, update your script to use asyncio : python import asyncio Other imports... async def main : LangGraph agent logic.. if name == " main ": asyncio.run main Step 5: Load the Apify MCP server tools Apify recommends connecting to its MCP server using Streamable HTTP https://modelcontextprotocol.io/specification/draft/basic/transports/streamable-http . For authentication, pass your Apify API token in the Authorization https://developer.mozilla.org/en-US/docs/Web/HTTP/Reference/Headers/Authorization header. Read the Apify API token from the APIFY TOKEN environment variable and add a configuration for connection to Apify MCP Server: python import os from langchain.mcp import MCPAdapter Read the Apify token from the envs APIFY TOKEN = os.environ "APIFY TOKEN" Define the Apify MCP Server configuration via Streamable HTTP mcp client = MCPAdapter { "apify": { "transport": "http", "url": "https://mcp.apify.com", The URL of Apify MCP Server "headers": { "Authorization": f"Bearer {APIFY TOKEN}" , }, }, Other MCP server configs here... } MCPAdapter https://reference.langchain.com/python/langchain/mcp/adapter/MCPAdapter is a client provided by langchain mcp that lets you connect to one or more MCP servers. In this example, only Apify MCP server is set up, but you can add additional MCP servers later. Note : The langchain.mcp namespace requires langchain mcp =1.4.0 . Next, load the tools exposed by the configured MCP servers: Load all the MCP tools tools = await mcp client.list tools list tools returns the MCP tools as LangChain-compatible tools. That means you can pass the returned tools list directly to your LangGraph agent. To verify that the Apify MCP server tools were loaded correctly, consider printing their names: print "\nAvailable Apify MCP tools:" for tool in tools: print f"- {tool.name}" The output will list the tools exposed by Apify MCP Server by default: Step 6: Define the agent Initialize the LangGraph agent by configuring the OpenAI model, system prompt, and MCP tools: Define the OpenAI model that will serve as the agent's brain model = ChatOpenAI model="gpt-5.4-mini" Specify the instructions that guide the agent's behavior agent system prompt = "You are a helpful research assistant. Use Apify MCP Server tools for " "web scraping, data extraction, and automation tasks." Create the LangGraph agent agent = create agent model=model, tools=tools, system prompt=agent system prompt, Step 7: Run the MCP LangGraph agent workflow To test the integration, give the agent a task that requires web access or any automation scenario supported by one or more Apify Actors. For example: user prompt = "Find Nike's latest post on TikTok and return relevant metrics, " "including sentiment analysis of the top comments." Pass the prompt to the agent and stream its output to the terminal: async for update in agent.astream { "messages": { "role": "user", "content": user prompt, } }, stream mode="updates", : for node name, node update in update.items : print f"\n{'=' 20} {node name} {'=' 20}" if "messages" not in node update: continue for message in node update "messages" : message.pretty print Step 8: Final Code The complete Python script for the MCP LangGraph agent workflow is: pip install langchain langchain-openai python-dotenv "langchain mcp " import asyncio from dotenv import load dotenv import os from langchain.mcp import MCPAdapter from langchain openai import ChatOpenAI from langchain.agents import create agent Load API keys from .env load dotenv async def main : Read the Apify token from the envs APIFY TOKEN = os.environ "APIFY TOKEN" Define the Apify MCP Server configuration via Streamable HTTP mcp client = MCPAdapter { "apify": { "transport": "http", "url": "https://mcp.apify.com", The URL of Apify MCP Server "headers": { "Authorization": f"Bearer {APIFY TOKEN}" , }, }, Other MCP server configs here... } Load all the MCP tools tools = await mcp client.list tools Define the OpenAI model that will serve as the agent's brain model = ChatOpenAI model="gpt-5.4-mini" Specify the instructions that guide the agent's behavior agent system prompt = "You are a helpful research assistant. Use Apify MCP Server tools for " "web scraping, data extraction, and automation tasks." Create the LangGraph agent agent = create agent model=model, tools=tools, system prompt=agent system prompt, Specify the agent's task user prompt = "Find Nike's latest post on TikTok and return relevant metrics, " "including sentiment analysis of the top comments." Stream the agent execution, including tool calls and results async for update in agent.astream { "messages": { "role": "user", "content": user prompt, } }, stream mode="updates", : for node name, node update in update.items : print f"\n{'=' 20} {node name} {'=' 20}" if "messages" not in node update: continue for message in node update "messages" : message.pretty print if name == " main ": asyncio.run main Execute the script. The agent should first call the search-actors tool with the “TikTok” keyword to find relevant Apify Actors: From the search results, the agent selects TikTok Comments Scraper https://apify.com/clockworks/tiktok-comments-scraper clockworks/tiktok-comments-scraper as the right Actor for the task. It then calls fetch-actor-details to learn what the Actor does and how to use it: Next, the agent uses the apify--web-fetch tool powered by Web Fetch Actor, to retrieve the Nike TikTok account page: From the returned HTML converted to Markdown, the agent discovers Nike's latest TikTok post. It then passes the post URL to clockworks/tiktok-comments-scraper and calls the Actor to retrieve the latest 20 comments via the call-actor tool: The agent then calls get-dataset-items to retrieve the dataset containing the scraped comments and related data: Finally, the MCP LangGraph agent analyzes the retrieved data and combines the relevant information into the final response: The produced output includes the available metrics for Nike's latest TikTok post, along with sentiment analysis of the retrieved comments. Verify the results by checking the original post: Next steps The LangGraph and Apify integrations above show how to build simple agents that use Apify tools. You can extend these workflows with more advanced LangGraph capabilities, such as: - Custom workflows : Combine deterministic steps, agentic nodes, conditional routing, and Apify tools to build more controlled workflows. - Persistence and memory https://docs.langchain.com/oss/python/langgraph/persistence : Save graph state and maintain context across runs, including workflows that work with Apify data over multiple steps. - Human-in-the-loop : Pause execution with interrupt https://docs.langchain.com/oss/python/langgraph/interrupts to review or approve actions, such as running an Apify Actor, before resuming the workflow. - Multi-agent workflows : Build specialized agents that collaborate on tasks. - Durable execution : Resume long-running workflows after failures without restarting from scratch, which is great for use cases involving longer-running Apify Actors. Conclusion These workflows give LangGraph agents access to real-time web data and a broad marketplace of ready-made AI tools through Apify. You can connect Apify through the official langchain-apify integration for direct access to specific tools, or use Apify MCP Server to let agents discover and use Actors dynamically. FAQ Does Apify support LangGraph? Yes. Apify supports LangGraph through the langchain-apify package, which provides LangChain-compatible tools for Apify Actors. You can use these tools in LangGraph agents and workflows. How does the official Apify LangChain integration work? The langchain-apify package wraps Apify Actors as LangChain tools with simplified input schemas. You can give these tools to an agent, letting it call Apify Actors for tasks such as web search, scraping, social media data extraction, and more. Does langchain-apify also work with LangGraph? Yes. langchain-apify supports both LangChain and LangGraph. The same package provides tools that you can bind to your LangGraph agent workflow, including dedicated tools, complete tool sets, and a generic tool for running other Apify Actors. What are the benefits of connecting a LangGraph agent to Apify MCP Server? Apify MCP Server lets a LangGraph agent discover and run Actors dynamically, access Actor results and storage, and use web data tools. This gives agents access to a broad marketplace of ready-made tools without requiring you to integrate each Actor individually.