Under maintenance

Pricing

Pay per usage

Try for free

Go to Apify Store

My Actor 24

Under maintenance

Try for free

Pricing

Pay per usage

Rating

0.0

(0)

Developer

Jan Kirchner

Actor stats

Bookmarked

Total users

Monthly active users

a month ago

Last modified

.actor/Dockerfile

# First, specify the base Docker image.
# You can see the Docker images from Apify at https://hub.docker.com/r/apify/.
# You can also use any other image from Docker Hub.
FROM apify/actor-python:3.11

# Second, copy just requirements.txt into the actor image,
# since it should be the only file that affects the dependency install in the next step,
# in order to speed up the build
COPY requirements.txt ./

# Install the packages specified in requirements.txt,
# Print the installed Python version, pip version
# and all installed packages with their versions for debugging
RUN echo "Python version:" \
 && python --version \
 && echo "Pip version:" \
 && pip --version \
 && echo "Installing dependencies:" \
 && pip install -r requirements.txt \
 && echo "All installed Python packages:" \
 && pip freeze

# Next, copy the remaining files and directories with the source code.
# Since we do this after installing the dependencies, quick build will be really fast
# for most source file changes.
COPY . ./

# Specify how to launch the source code of your actor.
# By default, the "python3 -m src" command is run
CMD ["python3", "-m", "src"]

.actor/actor.json

{
    "actorSpecification": 1,
    "name": "my-actor-24",
    "title": "Scrape single page in Python",
    "description": "Scrape data from single page with provided URL.",
    "version": "0.0",
    "meta": {
        "templateId": "python-start"
    },
    "input": "./input_schema.json",
    "dockerfile": "./Dockerfile"
}

.actor/input_schema.json

{
    "title": "Scrape data from a web page",
    "type": "object",
    "schemaVersion": 1,
    "properties": {
        "url": {
            "title": "URL of the page",
            "type": "string",
            "description": "The URL of website you want to get the data from.",
            "editor": "textfield",
            "prefill": "https://www.apify.com/"
        }
    },
    "required": ["url"]
}

.dockerignore

# configurations
.idea

# crawlee and apify storage folders
apify_storage
crawlee_storage
storage

# installed files
.venv

# git folder
.git

.editorconfig

root = true

[*]
indent_style = space
indent_size = 4
charset = utf-8
trim_trailing_whitespace = true
insert_final_newline = true
end_of_line = lf

.gitignore

# This file tells Git which files shouldn't be added to source control

.idea
.DS_Store

apify_storage
storage/*
!storage/key_value_stores
storage/key_value_stores/*
!storage/key_value_stores/default
storage/key_value_stores/default/*
!storage/key_value_stores/default/INPUT.json

.venv/
.env/
__pypackages__
dist/
build/
*.egg-info/
*.egg

__pycache__

.mypy_cache
.dmypy.json
dmypy.json
.pytest_cache

.scrapy
*.log

requirements.txt

1# Add your dependencies here.
2# See https://pip.pypa.io/en/latest/reference/requirements-file-format/
3# for how to format them
4apify ~= 1.1.1
5beautifulsoup4 ~= 4.12.0
6requests ~= 2.31.0

src/init.py

src/main.py

1import asyncio
2import logging
3
4from apify.log import ActorLogFormatter
5
6from .main import main
7
8# Set up logging of messages from the Apify SDK
9handler = logging.StreamHandler()
10handler.setFormatter(ActorLogFormatter())
11
12apify_client_logger = logging.getLogger('apify_client')
13apify_client_logger.setLevel(logging.INFO)
14apify_client_logger.addHandler(handler)
15
16apify_logger = logging.getLogger('apify')
17apify_logger.setLevel(logging.DEBUG)
18apify_logger.addHandler(handler)
19
20asyncio.run(main())

src/main.py

1# Apify SDK - toolkit for building Apify Actors (Read more at https://docs.apify.com/sdk/python).
2from apify import Actor
3# Requests - library for making HTTP requests in Python (Read more at https://requests.readthedocs.io)
4import requests
5# Beautiful Soup - library for pulling data out of HTML and XML files (Read more at https://www.crummy.com/software/BeautifulSoup/bs4/doc)
6from bs4 import BeautifulSoup
7
8async def main():
9    async with Actor:
10        # Structure of input is defined in input_schema.json
11        actor_input = await Actor.get_input() or {}
12        url = actor_input.get('url')
13
14        # Fetch the HTML content of the page.
15        response = requests.get(url)
16
17        # Parse the HTML content using Beautiful Soup.
18        soup = BeautifulSoup(response.content, 'html.parser')
19
20        # Extract all headings from the page (tag name and text).
21        headings = []
22        for heading in soup.find_all(['h1', 'h2', 'h3', 'h4', 'h5', 'h6']):
23            heading_object = { 'level': heading.name, 'text': heading.text }
24            print('Extracted heading', heading_object)
25            headings.append(heading_object)
26
27        # Save headings to Dataset - a table-like storage.
28        await Actor.push_data(headings)

My Actor 28

honzakirchner43/my-actor-28

Jan Kirchner

My Actor 311

honzakirchner43/my-actor-311

Jan Kirchner

My Actor 38

honzakirchner43/my-actor-38

Jan Kirchner

My Actor 291

honzakirchner43/my-actor-29

Jan Kirchner

My Actor 36

honzakirchner43/my-actor-36

Jan Kirchner

Test public

honzakirchner43/my-actor-12

Jan Kirchner

sdf

honzakirchner43/my-actor-27

sfd sdf

Jan Kirchner

copy-hello-world

honzakirchner43/my-iframe-test

Actor for run example iframe test

Jan Kirchner

Test-title

honzakirchner43/screenshot-url-mine

Actor serving as an example of Input Schema. Takes URL of website and screenshot configuration parameters as input and outputs a screenshot of the website into Key-Value store.

Jan Kirchner

Pay per event actor

honzakirchner43/pay-per-event-actor

Jan Kirchner

My Actor 24

.actor/Dockerfile

.actor/actor.json

.actor/input_schema.json

.dockerignore

.editorconfig

.gitignore

requirements.txt

src/__init__.py

src/__main__.py

src/main.py

You might also like

My Actor 28

My Actor 311

My Actor 38

My Actor 291

My Actor 36

Test public

sdf

copy-hello-world

Test-title

Pay per event actor

.actor/Dockerfile

.actor/actor.json

.actor/input_schema.json

.dockerignore

.editorconfig

.gitignore

requirements.txt

src/__init__.py

src/__main__.py

src/main.py

src/init.py

src/main.py

src/init.py

src/main.py