Redshift - Query Database with AWS API on New Message in Session from Zep API

Pipedream makes it easy to connect APIs for AWS, Zep and 2,800+ other apps remarkably fast.

Trigger workflow on

New Message in Session from the Zep API

Next, do this

Redshift - Query Database with the AWS API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Zep trigger and AWS action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Message in Session trigger
1. Connect your Zep account
2. Configure timer
Configure the Redshift - Query Database action
1. Connect your AWS account
2. Configure info
3. Select a AWS Region
4. Select a Workgroup Name
5. Select a Database Name
6. Optional- Configure SELECT Columns Clause
7. Configure FROM Clause
8. Optional- Configure WHERE Clause
9. Optional- Configure Order By
10. Optional- Configure Limit
11. Optional- Configure Parameters For WHERE Clause
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Message in Session on Zep

Description:Emit new event when a message is added to a session. [See the documentation](https://help.getzep.com/api-reference/memory/get-session-messages)

Version:0.0.1

Key:zep-new-message

View on GitHub

Trigger Code#

import common from "../common/base.mjs";

export default {
  ...common,
  key: "zep-new-message",
  name: "New Message in Session",
  description: "Emit new event when a message is added to a session. [See the documentation](https://help.getzep.com/api-reference/memory/get-session-messages)",
  version: "0.0.1",
  type: "source",
  dedupe: "unique",
  methods: {
    ...common.methods,
    async getNewResults(lastTs, max) {
      const sessionIds = await this.getRecentlyUpdatedSessionIds(lastTs);
      let messages = [];
      let maxTs = lastTs;

      for (const sessionId of sessionIds) {
        const results = this.paginateMessages(sessionId);

        for await (const message of results) {
          const ts = Date.parse(message.created_at);
          if (ts >= lastTs) {
            messages.push({
              ...message,
              session_id: sessionId,
            });
            maxTs = Math.max(maxTs, ts);
          }
        }
      }

      this._setLastTs(maxTs);

      // sort by created_at
      messages = messages.sort((a, b) => Date.parse(a.created_at) - Date.parse(b.created_at));

      if (max) {
        messages = messages.slice(-1 * max);
      }

      return messages;
    },
    async getRecentlyUpdatedSessionIds(lastTs) {
      const sessions = await this.getSessions({
        lastTs,
        orderBy: "updated_at",
        updateLastTs: false,
        max: 100,
      });
      return sessions?.map(({ session_id: id }) => id) || [];
    },
    async *paginateMessages(sessionId) {
      const params = {
        limit: 1000,
        cursor: 1,
      };
      let total;

      do {
        const { messages } = await this.zep.listMessages({
          sessionId,
          params,
        });
        for (const message of messages) {
          yield message;
        }
        total = messages?.length;
        params.cursor++;
      } while (total);
    },
    generateMeta(message) {
      return {
        id: message.uuid,
        summary: `New Message: ${message.content}`,
        ts: Date.parse(message.created_at),
      };
    },
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Zep	`zep`	`app`	This component uses the Zep app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
	`timer`	`$.interface.timer`

Trigger Authentication#

Zep uses API keys for authentication. When you connect your Zep account, Pipedream securely stores the keys so you can easily authenticate to Zep APIs in both code and no-code steps.

About Zep#

The Foundational Memory Layer for AI. Equip your agents with the knowledge to complete tasks, from the mundane to monumental.

Action#

Redshift - Query Database on AWS

Description:Run a SELECT query on a database. [See the documentation](https://docs.aws.amazon.com/redshift/latest/APIReference/API_ExecuteStatement.html)

Version:0.0.1

Key:aws-redshift-query-database

View on GitHub

AWS Overview#

The AWS API unlocks endless possibilities for automation with Pipedream. With this powerful combo, you can manage your AWS services and resources, automate deployment workflows, process data, and react to events across your AWS infrastructure. Pipedream offers a serverless platform for creating workflows triggered by various events that can execute AWS SDK functions, making it an efficient tool to integrate, automate, and orchestrate tasks across AWS services and other apps.

Action Code#

import app from "../../aws.app.mjs";
import {
  parseJson,
  parseArray,
} from "../../common/utils.mjs";

export default {
  key: "aws-redshift-query-database",
  name: "Redshift - Query Database",
  description: "Run a SELECT query on a database. [See the documentation](https://docs.aws.amazon.com/redshift/latest/APIReference/API_ExecuteStatement.html)",
  type: "action",
  version: "0.0.1",
  props: {
    app,
    info: {
      propDefinition: [
        app,
        "info",
      ],
    },
    region: {
      propDefinition: [
        app,
        "region",
      ],
    },
    workgroupName: {
      propDefinition: [
        app,
        "workgroupName",
        ({ region }) => ({
          region,
        }),
      ],
    },
    database: {
      propDefinition: [
        app,
        "database",
        ({
          region,
          workgroupName,
        }) => ({
          region,
          workgroupName,
        }),
      ],
    },
    columns: {
      type: "string[]",
      label: "SELECT Columns Clause",
      description: "List of columns to retrieve.",
      optional: true,
    },
    from: {
      type: "string",
      label: "FROM Clause",
      description: "The FROM clause to select from. e.g. `schema_name.table_name`",
    },
    where: {
      type: "string",
      label: "WHERE Clause",
      description: "The WHERE clause to filter rows. e.g. `id = :id`. Use named parameters to avoid SQL injection.",
      optional: true,
    },
    orderBy: {
      type: "string",
      label: "Order By",
      description: "Column to order the results by (e.g., `column_name ASC`, `column_name DESC`).",
      optional: true,
    },
    limit: {
      type: "integer",
      label: "Limit",
      description: "Maximum number of rows to return.",
      optional: true,
      default: 10,
    },
    sqlParameters: {
      propDefinition: [
        app,
        "sqlParameters",
      ],
    },
  },
  async run({ $ }) {
    const {
      region,
      workgroupName,
      database,
      columns: columnStrings,
      from,
      where,
      sqlParameters,
      orderBy,
      limit,
    } = this;

    const columns = parseArray(columnStrings);

    const effectiveColumns =
      columns?.length > 0
        ? columns.join(", ")
        : "*";

    let sql = `SELECT ${effectiveColumns} FROM ${from}`;

    if (where) {
      sql += ` WHERE ${where}`;
    }
    if (orderBy) {
      sql += ` ORDER BY ${orderBy}`;
    }
    if (limit) {
      sql += " LIMIT :limit";
    }
    const parameters = Object.entries({
      ...parseJson(sqlParameters),
      limit,
    })
      .map(([
        name,
        value,
      ]) => ({
        name,
        value: String(value),
      }));

    const response = await this.app.executeStatement({
      region,
      workgroupName,
      database,
      sql,
      parameters,
    });
    $.export("$summary", `Successfully found \`${response.TotalNumRows}\` row(s).`);
    return response;
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
AWS	`app`	`app`	This component uses the AWS app.
AWS Region	`region`	`string`	Select a value from the drop down menu.
Workgroup Name	`workgroupName`	`string`	Select a value from the drop down menu.
Database Name	`database`	`string`	Select a value from the drop down menu.
SELECT Columns Clause	`columns`	`string[]`	List of columns to retrieve.
FROM Clause	`from`	`string`	The FROM clause to select from. e.g. `schema_name.table_name`
WHERE Clause	`where`	`string`	The WHERE clause to filter rows. e.g. `id = :id`. Use named parameters to avoid SQL injection.
Order By	`orderBy`	`string`	Column to order the results by (e.g., `column_name ASC`, `column_name DESC`).
Limit	`limit`	`integer`	Maximum number of rows to return.
Parameters For WHERE Clause	`sqlParameters`	`object`	An object with parameters to use in the WHERE clause. e.g. `{ "id": 1 }`

Action Authentication#

AWS uses API keys for authentication. When you connect your AWS account, Pipedream securely stores the keys so you can easily authenticate to AWS APIs in both code and no-code steps.

Follow the AWS Instructions for creating an IAM user with an associated access and secret key.

As a best practice, attach the minimum set of IAM permissions necessary to perform the specific task in Pipedream. If your workflow only needs to perform a single API call, you should create a user and associate an IAM group / policy with permission to do only that task. You can create as many linked AWS accounts in Pipedream as you'd like.

Enter your access and secret key below.

About AWS#

Amazon Web Services (AWS) offers reliable, scalable, and inexpensive cloud computing services.

More Ways to Connect AWS + Zep#

Other Popular Integrations#

Add User with Zep API on New DynamoDB Stream Event from AWS API

AWS + Zep

Redshift - Query Database with AWS API on New Message in Session from Zep API

Pipedream makes it easy to connect APIs for AWS, Zep and 2,800+ other apps remarkably fast.

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

1-24of2,800+apps by most popular

1
-
24
of
2,800+
apps by most popular