> ## Documentation Index
> Fetch the complete documentation index at: https://v3.captaindata.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Website Scraper

> Extracts data from a website, such as emails and social network URLs (LinkedIn, Twitter, etc.).

The Website Scraper action is designed to extract valuable data from websites, including emails and social network URLs like LinkedIn, Twitter, and more. This action is particularly useful for gathering contact information and social media links from a specified domain.

### Inputs

<ParamField path="website" type="string" required={true} primary={true}>
  The URL of the website to scrape. Ensure it is a valid URL.
</ParamField>

### Parameters

<ParamField path="get_imgs" type="checkbox" default={false}>
  Intercepts all the image URLs when the website loads.
</ParamField>

<ParamField path="timeout" type="number" default={30000} maximum={60000}>
  Number of milliseconds before timing out.
</ParamField>

### Output Fields

The action returns a comprehensive set of data fields extracted from the website:

<ResponseField>
  <Expandable title="properties">
    <ResponseField name="domain" type="string">
      The domain of the website
    </ResponseField>

    <ResponseField name="email" type="string">
      Extracted email address
    </ResponseField>

    <ResponseField name="emails" type="array">
      List of extracted email addresses
    </ResponseField>

    <ResponseField name="facebook_url" type="string">
      The Facebook URL
    </ResponseField>

    <ResponseField name="facebook_urls" type="array">
      List of Facebook URLs
    </ResponseField>

    <ResponseField name="image_urls" type="array">
      List of image URLs
    </ResponseField>

    <ResponseField name="instagram_url" type="string">
      The Instagram URL
    </ResponseField>

    <ResponseField name="instagram_urls" type="array">
      List of Instagram URLs
    </ResponseField>

    <ResponseField name="linkedin_company_url" type="string">
      The LinkedIn company URL
    </ResponseField>

    <ResponseField name="linkedin_company_urls" type="array">
      List of LinkedIn company URLs
    </ResponseField>

    <ResponseField name="linkedin_profile_url" type="string">
      The LinkedIn profile URL
    </ResponseField>

    <ResponseField name="linkedin_profile_urls" type="array">
      List of LinkedIn profile URLs
    </ResponseField>

    <ResponseField name="linkedin_school_url" type="string">
      The LinkedIn school URL
    </ResponseField>

    <ResponseField name="linkedin_school_urls" type="array">
      List of LinkedIn school URLs
    </ResponseField>

    <ResponseField name="origin_website" type="string">
      The original website URL
    </ResponseField>

    <ResponseField name="phone" type="string">
      Extracted phone number
    </ResponseField>

    <ResponseField name="phones" type="array">
      List of extracted phone numbers
    </ResponseField>

    <ResponseField name="title" type="string">
      The title of the webpage
    </ResponseField>

    <ResponseField name="twitter_url" type="string">
      The Twitter URL
    </ResponseField>

    <ResponseField name="twitter_urls" type="array">
      List of Twitter URLs
    </ResponseField>

    <ResponseField name="url" type="string">
      The URL of the webpage
    </ResponseField>

    <ResponseField name="website" type="string">
      The website URL
    </ResponseField>

    <ResponseField name="youtube_url" type="string">
      The YouTube URL
    </ResponseField>

    <ResponseField name="youtube_urls" type="array">
      List of YouTube URLs
    </ResponseField>
  </Expandable>
</ResponseField>

Below is the JSON schema for the output fields:

<Accordion title="Show JSON Output Schema">
  ```json
  {
      "domain": "string",
      "email": "string",
      "emails": ["string"],
      "facebook_url": "string",
      "facebook_urls": ["string"],
      "image_urls": ["string"],
      "instagram_url": "string",
      "instagram_urls": ["string"],
      "linkedin_company_url": "string",
      "linkedin_company_urls": ["string"],
      "linkedin_profile_url": "string",
      "linkedin_profile_urls": ["string"],
      "linkedin_school_url": "string",
      "linkedin_school_urls": ["string"],
      "origin_website": "string",
      "phone": "string",
      "phones": ["string"],
      "title": "string",
      "twitter_url": "string",
      "twitter_urls": ["string"],
      "url": "string",
      "website": "string",
      "youtube_url": "string",
      "youtube_urls": ["string"]
  }
  ```
</Accordion>

### Specificities

<Info>
  This action navigates only to the root URL (home) of the provided domain.
</Info>

<Note>
  For optimal performance, it is recommended not to exceed 1000 rows in your
  input CSV file.
</Note>

<Steps>
  <Step title="Batch Processing">
    This action processes inputs in batches of 500. If you provide 1000 inputs,
    it will process the first 500 and queue the remaining 500 for later
    processing.
  </Step>

  <Step title="Metadata Tracking">
    When enriching a list of domains with LinkedIn, consider adding an extra
    column (e.g., "index\_id") to your data as metadata. This helps track which
    domains have been successfully enriched.
  </Step>
</Steps>