Scrape without JS with ScrapeNinja API on New Account Added from Outseta API

Pipedream makes it easy to connect APIs for ScrapeNinja, Outseta and 2,700+ other apps remarkably fast.

Trigger workflow on

New Account Added from the Outseta API

Next, do this

Scrape without JS with the ScrapeNinja API

No credit card required

▶

Watch us build a workflow

8 min

Watch now ➜

Trusted by 1,000,000+ developers from startups to Fortune 500 companies

Developers ♥ Pipedream

Getting Started#

This integration creates a workflow with a Outseta trigger and ScrapeNinja action. When you configure and deploy the workflow, it will run on Pipedream's servers 24x7 for free.

Select this integration
Configure the New Account Added trigger
1. Connect your Outseta account
2. Configure timer
Configure the Scrape without JS action
1. Connect your ScrapeNinja account
2. Configure URL
3. Optional- Configure Headers
4. Optional- Configure Retry Number
5. Optional- Configure Geo
6. Optional- Configure Proxy
7. Optional- Configure Follow Redirects
8. Optional- Configure Timeout
9. Optional- Configure Text Not Expected
10. Optional- Configure Status Not Expected
11. Optional- Configure Extractor
Deploy the workflow
Send a test event to validate your setup
Turn on the trigger

Details#

This integration uses pre-built, source-available components from Pipedream's GitHub repo. These components are developed by Pipedream and the community, and verified and maintained by Pipedream.

To contribute an update to an existing component or create a new component, create a PR on GitHub. If you're new to Pipedream component development, you can start with quickstarts for trigger span and action development, and then review the component API reference.

Trigger#

New Account Added on Outseta

Description:Emit new event when an account is added. [See the documentation](https://documenter.getpostman.com/view/3613332/outseta-rest-api-v1/7TNfr6k#7c31f27f-bbeb-40e4-1cf7-39de1ea59a8c)

Version:0.0.1

Key:outseta-new-account

View on GitHub

Outseta Overview#

The Outseta API provides a versatile set of endpoints for interacting with a company's CRM, subscription billing, customer support, and email marketing functionalities. With this API on Pipedream, you can automate tasks, synchronize data across platforms, and build powerful workflows that cater to various aspects of SaaS business operations. Pipedream's serverless execution model enables integrating Outseta's services with numerous other apps without managing infrastructure, focusing on logic and efficiency.

Trigger Code#

import base from "../common/base.mjs";

export default {
  ...base,
  key: "outseta-new-account",
  name: "New Account Added",
  description: "Emit new event when an account is added. [See the documentation](https://documenter.getpostman.com/view/3613332/outseta-rest-api-v1/7TNfr6k#7c31f27f-bbeb-40e4-1cf7-39de1ea59a8c)",
  version: "0.0.1",
  type: "source",
  dedupe: "unique",
  methods: {
    ...base.methods,
    listingFn($) {
      return this.app.getAllAccounts({
        $,
        limit: 100,
        params: {
          orderBy: "Created+DESC",
        },
      });
    },
    getMeta(item) {
      return {
        id: item.Uid,
        summary: `New Account - ${item.Name}`,
        ts: new Date(item.Created),
      };
    },
  },
};

Trigger Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI and CLI.

Label	Prop	Type	Description
Outseta	`app`	`app`	This component uses the Outseta app.
N/A	`db`	`$.service.db`	This component uses `$.service.db` to maintain state between executions.
	`timer`	`$.interface.timer`

Trigger Authentication#

Outseta uses API keys for authentication. When you connect your Outseta account, Pipedream securely stores the keys so you can easily authenticate to Outseta APIs in both code and no-code steps.

To retrieve your API Keys,

Navigate to your Outseta account and sign in
Go to “Settings” > “Integrations” > “API Keys”

Your domain is 1234 if your Outseta dashboard URL is https://1234.outseta.com/#/app/dashboard

About Outseta#

A better way to launch your SaaS start-up, membership site, or online community.

Action#

Scrape without JS on ScrapeNinja

Description:Use high-performance web scraping endpoint with Chrome browser TLS fingerprint, but without JavaScript execution and real browser overhead. [See the documentation](https://scrapeninja.net/docs/api-reference/scrape/)

Version:0.0.1

Key:scrapeninja-scrape-without-js

View on GitHub

ScrapeNinja Overview#

ScrapeNinja API on Pipedream allows you to craft powerful serverless workflows for web scraping without the hassle of managing proxies or browsers. It's a tool that can extract data from websites, handling JavaScript rendering and anti-bot measures with ease. By integrating ScrapeNinja with Pipedream, you can automate data collection, collate and process the scraped data, and connect it to numerous other services for further analysis, alerting, or storage.

Action Code#

import { ConfigurationError } from "@pipedream/platform";
import { parseObject } from "../../common/utils.mjs";
import scrapeninja from "../../scrapeninja.app.mjs";

export default {
  key: "scrapeninja-scrape-without-js",
  name: "Scrape without JS",
  description: "Use high-performance web scraping endpoint with Chrome browser TLS fingerprint, but without JavaScript execution and real browser overhead. [See the documentation](https://scrapeninja.net/docs/api-reference/scrape/)",
  version: "0.0.1",
  type: "action",
  props: {
    scrapeninja,
    url: {
      propDefinition: [
        scrapeninja,
        "url",
      ],
    },
    headers: {
      propDefinition: [
        scrapeninja,
        "headers",
      ],
      optional: true,
    },
    retryNum: {
      propDefinition: [
        scrapeninja,
        "retryNum",
      ],
      optional: true,
    },
    geo: {
      propDefinition: [
        scrapeninja,
        "geo",
      ],
      optional: true,
    },
    proxy: {
      propDefinition: [
        scrapeninja,
        "proxy",
      ],
      optional: true,
    },
    followRedirects: {
      propDefinition: [
        scrapeninja,
        "followRedirects",
      ],
      optional: true,
    },
    timeout: {
      propDefinition: [
        scrapeninja,
        "timeout",
      ],
      optional: true,
    },
    textNotExpected: {
      propDefinition: [
        scrapeninja,
        "textNotExpected",
      ],
      optional: true,
    },
    statusNotExpected: {
      propDefinition: [
        scrapeninja,
        "statusNotExpected",
      ],
      optional: true,
    },
    extractor: {
      propDefinition: [
        scrapeninja,
        "extractor",
      ],
      optional: true,
    },
  },
  async run({ $ }) {
    try {
      const response = await this.scrapeninja.scrapeNonJs({
        $,
        data: {
          url: this.url,
          headers: parseObject(this.headers),
          retryNum: this.retryNum,
          geo: this.geo,
          proxy: this.proxy,
          followRedirects: this.followRedirects,
          timeout: this.timeout,
          textNotExpected: parseObject(this.textNotExpected),
          statusNotExpected: parseObject(this.statusNotExpected),
          extractor: this.extractor,
        },
      });
      $.export("$summary", "Successfully scraped the URL");
      return response;
    } catch ({ response: { data } }) {
      throw new ConfigurationError(data.message || data.stderr);
    }
  },
};

Action Configuration#

This component may be configured based on the props defined in the component code. Pipedream automatically prompts for input values in the UI.

Label	Prop	Type	Description
ScrapeNinja	`scrapeninja`	`app`	This component uses the ScrapeNinja app.
URL	`url`	`string`	The URL to scrape.
Headers	`headers`	`string[]`	Custom headers to send with the request. By default, regular Chrome browser headers are sent to the target URL.
Retry Number	`retryNum`	`integer`	Amount of attempts.
Geo	`geo`	`string`	Geo location for basic proxy pools (you can purchase premium ScrapeNinja proxies for wider country selection and higher proxy quality). Read more about ScrapeNinja proxy setup
Proxy	`proxy`	`string`	Premium or your own proxy URL (overrides `Geo` prop). Read more about ScrapeNinja proxy setup
Follow Redirects	`followRedirects`	`integer`	Whether to follow redirects.
Timeout	`timeout`	`integer`	Timeout per attempt, in seconds. Each retry will take [timeout] number of seconds.
Text Not Expected	`textNotExpected`	`string[]`	Text which will trigger a retry from another proxy address.
Status Not Expected	`statusNotExpected`	`integer[]`	HTTP response statuses which will trigger a retry from another proxy address.
Extractor	`extractor`	`string`	Custom JS function to extract JSON values from scraped HTML. Write&test your own extractor on https://scrapeninja.net/cheerio-sandbox/

Action Authentication#

ScrapeNinja uses API keys for authentication. When you connect your ScrapeNinja account, Pipedream securely stores the keys so you can easily authenticate to ScrapeNinja APIs in both code and no-code steps.

Using ScrapingNinja in Pipedream

Create a RapidAPI Account: Begin by signing up for a RapidAPI account.
Access Your API Key:
- Once registered, you'll be able to interact with ScrapingNinja using your RapidAPI key.
- Open the ScrapingNinja documentation on RapidAPI and locate your API key labeled X-RapidAPI-Key.
- Copy this key and paste it into the rapid_api_key field below.
Subscribe to the API: Finally, click Subscribe to Test in the RapidAPI console to subscribe to the ScrapingNinja API.

About ScrapeNinja#

Extract Web Data on Scale

More Ways to Connect ScrapeNinja + Outseta#

Other Popular Integrations#

Scrape with JS Rendering with ScrapeNinja API on New Account Added from Outseta API

Outseta + ScrapeNinja

Try it

Scrape with JS Rendering with ScrapeNinja API on New Deal Added from Outseta API

Outseta + ScrapeNinja

Try it

Scrape with JS Rendering with ScrapeNinja API on New Person Added from Outseta API

Outseta + ScrapeNinja

Try it

Scrape without JS with ScrapeNinja API on New Deal Added from Outseta API

Outseta + ScrapeNinja

Try it

Scrape without JS with ScrapeNinja API on New Person Added from Outseta API

Outseta + ScrapeNinja

Try it

Popular Triggers#

New Account Added from the Outseta API

Emit new event when an account is added. See the documentation

Try it

New Deal Added from the Outseta API

Emit new event when a deal is added. See the documentation

Try it

New Person Added from the Outseta API

Emit new event when a person is added. See the documentation

Try it

Popular Actions#

Add Account with the Outseta API

Add account with existing person. See the documentation

Try it

Add Deal with the Outseta API

Add a new deal record to CRM. See the documentation

Try it

Add Person with the Outseta API

Add a person record to CRM. See the documentation

Try it

Scrape with JS Rendering with the ScrapeNinja API

Uses the ScrapeNinja real Chrome browser engine to scrape pages that require JS rendering. See the documentation

Try it

Scrape without JS with the ScrapeNinja API

Use high-performance web scraping endpoint with Chrome browser TLS fingerprint, but without JavaScript execution and real browser overhead. See the documentation

Try it