ScrapFly

scrapfly is a web scraping api that enables automated data extraction from websites integrating scrapfly with make com allows users to automate data collection, manage scraping tasks, and process extracted web data within their workflows this is ai generated content based on official scrapfly documentation the content may contain mistakes please verify important information if you have questions on vendor documentation, contact https //scrapfly io/docs directly requirements to use the scrapfly app in make, you must have an active account and an api key, https //scrapfly io/ for subscription, refer to the https //scrapfly io/ connect scrapfly and {{product name}} to get started, you must first create a connection between scrapfly and {{product name}} , allowing the two services to communicate obtain your api key in your scrapfly account create the connection in make obtain your api key in your scrapfly account before you create the connection in {{product name}} , you should first obtain your api key in your scrapfly account to obtain your api key navigate to the projects dashboard select the desired project from the list select either the live or test environment as required copy the api key displayed at the top of the dashboard you will use this value while creating a connection in {{product name}} because the ui might have changed, the steps you see on your screen might be different, https //scrapfly io/docs/project create the connection in {{product name}} https //www make com/en/register , add the scrapfly module to your {{scenario singular lowercase}} , and click create a connection if you add a module with an instant tag, click create a webhook , then create a connection optional in the connection name field, enter a name for the connection enter the authentication credentials you copied from your scrapfly account or follow the on screen instructions to create the connection for detailed information on connecting an application, see docid\ so88fm6pkt0g adkddfzz page scrapfly modules after connecting to the scrapfly app, you can choose from a list of available modules to build your {{scenario plural lowercase}} capture a web page screenshot captures and saves an image of an entire web page based on the url you provide extract data from an html, text, or markdown document using ai extracts structured information from any text by using ai, large language models (llms), and your custom parsing instructions get an account info retrieves detailed information about your current subscription plan and how much of your account's usage limits you have used scrape a web page extracts content from a web page and returns it in html, plain text, or markdown format send a web scraping api request sends an api request through scrapfly, utilizing proxies and anti bot bypass features to help access and retrieve data from protected websites templates you can look for more templates in https //www make com/en/templates , where you'll find thousands of pre created {{scenario plural lowercase}} scrapfly resources you can have access to more resources related to this app on the following links https //community make com/search?q=scrapfly https //scrapfly io/ https //scrapfly io/docs https //www make com/en/integrations/scrapfly