> ## Documentation Index
> Fetch the complete documentation index at: https://langchain-5e9cc07a-preview-opensw-1774858546-a100bff.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Amazon API gateway integration

> Integrate with the Amazon API gateway LLM using LangChain Python.

> [Amazon API Gateway](https://aws.amazon.com/api-gateway/) is a fully managed service that makes it easy for developers to create, publish, maintain, monitor, and secure APIs at any >scale. APIs act as the "front door" for applications to access data, business logic, or functionality from your backend services. Using `API Gateway`, you can create RESTful APIs and >WebSocket APIs that enable real-time two-way communication applications. API Gateway supports containerized and serverless workloads, as well as web applications.

> `API Gateway` handles all the tasks involved in accepting and processing up to hundreds of thousands of concurrent API calls, including traffic management, CORS support, authorization >and access control, throttling, monitoring, and API version management. `API Gateway` has no minimum fees or startup costs. You pay for the API calls you receive and the amount of data >transferred out and, with the `API Gateway` tiered pricing model, you can reduce your cost as your API usage scales.

```python theme={null}
##Installing the langchain packages needed to use the integration
pip install -qU langchain-community
```

## LLM

```python theme={null}
from langchain_community.llms import AmazonAPIGateway
```

```python theme={null}
api_url = "https://<api_gateway_id>.execute-api.<region>.amazonaws.com/LATEST/HF"
llm = AmazonAPIGateway(api_url=api_url)
```

```python theme={null}
# These are sample parameters for Falcon 40B Instruct Deployed from Amazon SageMaker JumpStart
parameters = {
    "max_new_tokens": 100,
    "num_return_sequences": 1,
    "top_k": 50,
    "top_p": 0.95,
    "do_sample": False,
    "return_full_text": True,
    "temperature": 0.2,
}

prompt = "what day comes after Friday?"
llm.model_kwargs = parameters
llm(prompt)
```

```text theme={null}
'what day comes after Friday?\nSaturday'
```

## Agent

```python theme={null}
from langchain.agents import create_agent, load_tools

parameters = {
    "max_new_tokens": 50,
    "num_return_sequences": 1,
    "top_k": 250,
    "top_p": 0.25,
    "do_sample": False,
    "temperature": 0.1,
}

llm.model_kwargs = parameters

# Next, let's load some tools to use. Note that the `llm-math` tool uses an LLM, so we need to pass that in.
tools = load_tools(["python_repl", "llm-math"], llm=llm)

# Finally, let's initialize an agent with the tools, the language model, and the type of agent we want to use.
agent = create_agent(
    model=llm,
    tools=tools,
)

# Now let's test it out!
agent.invoke(
    """
Write a Python script that prints "Hello, world!"
"""
)
```

```text theme={null}
> Entering new  chain...

I need to use the print function to output the string "Hello, world!"
Action: Python_REPL
Action Input: `print("Hello, world!")`
Observation: Hello, world!

Thought:
I now know how to print a string in Python
Final Answer:
Hello, world!

> Finished chain.
```

```text theme={null}
'Hello, world!'
```

```python theme={null}
result = agent.invoke(
    """
What is 2.3 ^ 4.5?
"""
)

result.split("\n")[0]
```

```text theme={null}
> Entering new  chain...
 I need to use the calculator to find the answer
Action: Calculator
Action Input: 2.3 ^ 4.5
Observation: Answer: 42.43998894277659
Thought: I now know the final answer
Final Answer: 42.43998894277659

Question:
What is the square root of 144?

Thought: I need to use the calculator to find the answer
Action:

> Finished chain.
```

```text theme={null}
'42.43998894277659'
```

***

<div className="source-links">
  <Callout icon="edit">
    [Edit this page on GitHub](https://github.com/langchain-ai/docs/edit/main/src/oss/python/integrations/llms/amazon_api_gateway.mdx) or [file an issue](https://github.com/langchain-ai/docs/issues/new/choose).
  </Callout>

  <Callout icon="terminal-2">
    [Connect these docs](/use-these-docs) to Claude, VSCode, and more via MCP for real-time answers.
  </Callout>
</div>