Sign up on the Apify platform and verify your email to activate the account.
Install the Apify CLI using NPM or Homebrew for local development and deployment.
Ensure Node.js and NPM are installed for running and managing Actors locally.
Use the apify create command to initialize a project directory and select a template (e.g., "Hello World").
Write custom scraping or automation logic using JavaScript, Python, or other supported languages.
Define input parameters for your Actor to accept dynamic configurations during execution.
Run the Actor locally using apify run to debug and refine functionality
Push the Actor to the cloud using apify push, which uploads and builds it on the platform.
Set up automated runs at specific intervals using the scheduling feature on the platform.
Apify can be customized to fit specific business needs through its versatile features and professional services. Here are the key data points:
Build Custom Actors: Developers can create tailored web scrapers and automation tools using JavaScript, Python, or templates provided by Apify.
Professional Services: Apify's team offers end-to-end custom solutions, including designing, developing, and deploying bespoke workflows tailored to unique business requirements.
Custom Input Parameters: Actors can be configured with dynamic input settings to adapt to specific scraping tasks or automation needs.
API Integration: Businesses can integrate Apify with their existing systems using RESTful APIs for seamless data transfer and workflow automation.
Webhook Support: Automate actions triggered by system events, such as sending notifications or processing scraped data in real-time.
Actor-to-Actor Automation: Connect multiple Actors to create complex workflows that process data sequentially or collaboratively.
Custom Data Formats: Export data in formats like JSON, CSV, Excel, or HTML to meet organizational standards.
Enhanced Scalability: Apify supports scaling operations to scrape millions of pages per month and handle terabytes of data.
Custom Security Features: Enterprise-grade security options include private deployments and compliance with SOC 2 standards.
Integration with AI Tools: Feed scraped data into AI models, LLM applications, or vector databases for advanced analytics and insights.
Custom Scheduling: Automate scraping tasks at predefined intervals to optimize workflows.
Apify does not charge setup fees or mandatory maintenance costs, but there are additional costs based on usage and optional services. Here are the details:
Charged per CU usage, starting at $0.4 per CU for lower-tier plans and decreasing to $0.25 per CU for higher-tier plans.
Datacenter proxies start at $0.6/IP for Business Plan users.
Personal training: $150/hour.
Timed storage costs $1 per 1,000 GB-hours for datasets, key-value stores, and request queues, with discounts for higher-tier plans.
Internal transfer within the platform: $0.05/GB.
Pay-per-result or pay-per-event pricing models for monetized Actors.
Users exceeding prepaid limits are charged based on unit prices applicable to their subscription plan.
Apify offers extensive training and support options to help new users get started and maximize their platform usage:
Web Scraping Academy: Free courses ranging from beginner to advanced levels, covering topics like web scraping basics, API scraping, anti-scraping measures, and expert-level scraper development.
Personal Tech Training: Scale plan users receive 1 hour of personalized training per quarter, while Business plan users get 1 hour per month. This includes debugging Actors, optimizing performance, and integration guidance.
Documentation and Tutorials: Comprehensive guides on creating Actors, deploying workflows, and integrating with other tools like GitHub and APIs.
Code Templates: Ready-to-use templates in JavaScript, Python, and TypeScript for quick project setup.
Discord Community: Access to a developer community with over 8,500 members for peer-to-peer support and collaboration.
Live Chat Support: Available for general questions; priority chat is offered to Scale and Business plan users.
Professional Services: Custom onboarding workshops, tailored solutions, and enterprise-level SLAs for mission-critical projects.
Apify implements robust security measures to protect user data, ensuring compliance with industry standards and safeguarding against unauthorized access. Key security measures include:
Encryption in Transit: All data transferred via public networks is encrypted using SSL/TLS protocols.
Encryption at Rest: User data stored in databases (e.g., MongoDB on AWS) is encrypted, including backups and snapshots.
Encrypted Environment Variables: Configuration secrets and input parameters for Actors are encrypted for added security.
Two-Factor Authentication (2FA): Users can enable 2FA to secure accounts against unauthorized access.
Session Management: Configurable session lengths allow users to limit the duration of login sessions, reducing risks from compromised devices.
OAuth Tokens and API Keys: Secure authentication for API access ensures granular control over projects and accounts.
SOC 2 Type II Compliance: Independent audits verify that Apify meets high standards for security, availability, and confidentiality.
Redundancy and Failover: Servers and databases have replicas for redundancy, ensuring uptime and reliability during outages.
Isolated Environments: Tasks run in isolated computational, storage, and network environments to prevent interference or data leaks between users.
Vulnerability Monitoring: Automated tools like npm audit scan for vulnerabilities in code dependencies, while updates are regularly applied to all software components.
Incident Management: Failures or outages are logged and reflected on the Apify status page, with users notified of incidents and resolutions.
Adheres to GDPR, SOC 2, and CCPA regulations for data privacy and security.
PCI-compliant payment processing ensures that sensitive credit card information is never stored by Apify.
Operational data (e.g., logs) is retained based on subscription plans and securely deleted after the retention period.
Apify releases updates regularly, with minor updates typically occurring monthly and major updates about once a year. These updates are managed through a structured process, including changelogs documenting notable changes, bug fixes, and new features. Updates to the Apify SDK and platform are announced in the documentation and GitHub repositories, ensuring transparency for developers. Additionally, Actors on the Apify platform can be updated individually by their creators to adapt to changes in website layouts or data structures. Users are notified of maintenance or feature releases through the Actor's page and changelogs, enabling seamless integration of improvements into workflows. This consistent update cycle ensures Apify remains optimized for evolving web scraping and automation needs.
Apify policies on data ownership and portability are designed to ensure transparency and user control over personal data. Here's an overview:
Data Ownership:
User-Controlled Data: When you use Apify's platform to collect and manage personal data, you act as the "data controller," and Apify functions as the "data processor." This means you retain ownership and control over the data, while Apify processes it on your behalf.
Data Portability:
Apify offers flexible subscription plans that allow organizations to scale their usage up or down based on evolving needs. Here's an overview of how you can adjust your Apify subscription:
Upgrading Your Plan:
Immediate Effect: When you upgrade to a higher-tier plan, the change takes effect immediately. The system calculates a prorated charge based on the difference between the new and current plan prices and the remaining time in your billing cycle. This ensures you're only billed for the upgraded service during the current period. Apify Help & Support
Downgrading Your Plan:
End of Billing Cycle: Downgrades to a lower-tier plan become effective at the start of the next billing cycle. This approach allows you to utilize the features of your current plan until the end of the ongoing billing period.
Billing and Proration Details:
Prorated Charges: For upgrades, the prorated amount is calculated by subtracting the cost of your current plan from the new plan's cost, adjusted for the time remaining in your billing cycle. For example, if you move from a $49/month plan to a $499/month plan midway through the cycle, the additional charge would reflect the remaining half-month at the higher rate. Apify Help & Support
Prepaid Usage Adjustment: Upon upgrading, your prepaid usage balance is adjusted to account for the new plan's pricing and the time left in the billing period, ensuring accurate billing aligned with your actual usage.
Selecting the Appropriate Plan:
Compute Units (CUs): Each plan offers a specific number of compute units, which are essential for running tasks on the Apify platform. Assess your anticipated workload to choose a plan that aligns with your compute unit requirements.
Apify provides clear terms and conditions regarding subscription renewals and cancellations to accommodate the evolving needs of its users. Below is a detailed overview:
Subscription Renewal:
Automatic Renewal: Apify's subscriptions automatically renew at the end of each billing cycle, ensuring uninterrupted access to services.
Cancellation Policy:
Cancellation Process: Users can cancel their subscriptions at any time through the Billing settings in the Apify Console. Upon cancellation, the subscription remains active until the end of the current billing cycle and will not be renewed thereafter.
Overage Charges: Even after cancellation, users may incur charges for any platform usage that exceeds the prepaid amount (overages). These overages will be invoiced as part of the final invoice.
Refund Policy: Apify does not provide refunds for fees or other amounts paid before cancellation. All payments are final.
Upgrading or Downgrading Plans:
Upgrades: Users can upgrade to a higher-tier plan at any time. The system calculates a prorated charge based on the difference between the new and current plan prices and the remaining time in the billing cycle. The upgrade takes effect immediately upon payment.
Downgrades: Downgrading to a lower-tier plan becomes effective at the start of the next billing cycle. No proration is applied, except for unused platform usage credits, which are rolled over to the new plan. Users retain access to the features of their current plan until the end of the ongoing billing period.
Actor Rentals:
Automatic Renewal: Actor rentals are automatically renewed at the end of each rental period. To avoid unexpected charges, users should cancel the rental before the current period expires if they no longer wish to use the Actor.
Cancellation: Users can cancel Actor rentals during the trial period or at any time afterward to prevent charges for the subsequent rental period. Cancellation ensures that the rental will not renew after the current period ends.
Additional Considerations:
Overages: If platform usage exceeds the prepaid amount, overage charges apply. For paying users, the platform continues to be accessible, and overages are charged until the user-defined usage limit is reached. Free plan users will be blocked until the next billing cycle upon exceeding their limits.
Apify is committed to maintaining high standards of data security and privacy by adhering to several key compliance frameworks:
SOC 2 Type II Compliance: Apify has achieved SOC 2 Type II compliance, a rigorous standard developed by the American Institute of Certified Public Accountants (AICPA). This certification verifies that Apify's systems are designed to ensure the security, availability, and confidentiality of customer data.
General Data Protection Regulation (GDPR): As a European company, Apify complies with the GDPR, which governs the processing of personal data within the European Union. Apify acts as a data processor on behalf of its customers, implementing appropriate technical and organizational measures to protect personal data. Detailed information about Apify's GDPR compliance practices is available in their GDPR Information document.
California Consumer Privacy Act (CCPA): Apify aligns its operations with the CCPA, ensuring that the personal information of California residents is handled with transparency and respect for privacy rights. This includes providing mechanisms for data access, deletion, and opting out of data sales, by CCPA requirements.
Apify
By Apify Technologies s.r.o
