Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
code4craft
/
webmagic
Public
Notifications
You must be signed in to change notification settings
Fork
4.1k
Star
11.7k
Code
Issues
337
Pull requests
30
Actions
Projects
Wiki
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Wiki
Security and quality
Insights
Commits
Branch selector
develop
User selector
All users
All time
Commit history
Commits on Jul 4, 2025
Bump org.jruby:jruby from 9.3.9.0 to 9.4.12.1 (#1192)
Show description for 67816a1
dependabot[bot]
authored
67816a1
View commit details
Copy full SHA for 67816a1
Browse repository at this point
Upgrade parent from 2.2.1 to 2.3.1.
sutra
committed
eed2b44
View commit details
Copy full SHA for eed2b44
Browse repository at this point
Commits on Apr 4, 2025
Fix us.codecraft.webmagic.scheduler.FileCacheQueueScheduler#readCursorFile, refs #1175.
sutra
committed
d877fa5
View commit details
Copy full SHA for d877fa5
Browse repository at this point
Commits on Feb 13, 2025
Lookup parent from repository.
sutra
committed
36533c7
View commit details
Copy full SHA for 36533c7
Browse repository at this point
Commits on Feb 10, 2025
Update for next development version
sutra
committed
e2cc740
View commit details
Copy full SHA for e2cc740
Browse repository at this point
Merge tag 'WebMagic-1.0.3' into develop
Show description for c580acb
sutra
committed
c580acb
View commit details
Copy full SHA for c580acb
Browse repository at this point
Merge branch 'release/1.0.3'
sutra
committed
cfae008
View commit details
Copy full SHA for cfae008
Browse repository at this point
Update versions for release
sutra
committed
f4a8825
View commit details
Copy full SHA for f4a8825
Browse repository at this point
Commits on Dec 31, 2024
Update LICENSE, fix license year (#1186)
Show description for 7efc987
Jason N. White
authored
7efc987
View commit details
Copy full SHA for 7efc987
Browse repository at this point
Commits on Dec 22, 2024
Remove useless modifier.
sutra
committed
42a1727
View commit details
Copy full SHA for 42a1727
Browse repository at this point
Commits on Dec 18, 2024
Set page status code for SeleniumDownloader. Fixes #1185
sutra
committed
b1cf7ae
View commit details
Copy full SHA for b1cf7ae
Browse repository at this point
Commits on Dec 11, 2024
修改SmartContentSelector threshold可定制化 (#1183)
Show description for 9bb2417
zyw61483
and
zhaoyiwei
authored
9bb2417
View commit details
Copy full SHA for 9bb2417
Browse repository at this point
Commits on Dec 7, 2024
fix: webmagic-scripts/pom.xml to reduce vulnerabilities (#1181)
Show description for 1cd199b
code4craft
and
snyk-bot
authored
1cd199b
View commit details
Copy full SHA for 1cd199b
Browse repository at this point
Commits on Nov 26, 2024
Update for next development version
sutra
committed
8dc4174
View commit details
Copy full SHA for 8dc4174
Browse repository at this point
Merge branch 'release/1.0.2'
sutra
committed
837253c
View commit details
Copy full SHA for 837253c
Browse repository at this point
Merge tag 'WebMagic-1.0.2' into develop
Show description for 851063b
sutra
committed
851063b
View commit details
Copy full SHA for 851063b
Browse repository at this point
Update versions for release
sutra
committed
bf1088b
View commit details
Copy full SHA for bf1088b
Browse repository at this point
Polish code.
sutra
committed
c20edb8
View commit details
Copy full SHA for c20edb8
Browse repository at this point
Add static methods to construct Page.
sutra
committed
0a9fe8d
View commit details
Copy full SHA for 0a9fe8d
Browse repository at this point
Commits on Nov 23, 2024
Updated README.md, fix typo(s) (#1180)
Bob Conan
authored
7e500d7
View commit details
Copy full SHA for 7e500d7
Browse repository at this point
Commits on Oct 25, 2024
Update for next development version
sutra
committed
6ed8376
View commit details
Copy full SHA for 6ed8376
Browse repository at this point
Merge tag 'WebMagic-1.0.1' into develop
Show description for 63e6750
sutra
committed
63e6750
View commit details
Copy full SHA for 63e6750
Browse repository at this point
Merge branch 'release/1.0.1'
sutra
committed
e98f7d7
View commit details
Copy full SHA for e98f7d7
Browse repository at this point
Update versions for release
sutra
committed
6eab7a4
View commit details
Copy full SHA for 6eab7a4
Browse repository at this point
Commits on Oct 9, 2024
Bump commons-io:commons-io from 2.11.0 to 2.14.0 (#1179)
Show description for 50026ff
dependabot[bot]
authored
50026ff
View commit details
Copy full SHA for 50026ff
Browse repository at this point
Change the default status code from 200 to 0 & downloadSuccess from true to false, for Page.
sutra
committed
541ced9
View commit details
Copy full SHA for 541ced9
Browse repository at this point
Commits on Oct 5, 2024
fix: pom.xml to reduce vulnerabilities (#1178)
Show description for 19f60bf
code4craft
and
snyk-bot
authored
19f60bf
View commit details
Copy full SHA for 19f60bf
Browse repository at this point
Commits on Aug 19, 2024
FileCacheQueueScheduler使用BloomFilter进行去重 (#1176)
Show description for 15ec80f
blanexie
and
xiezhicheng02
authored
15ec80f
View commit details
Copy full SHA for 15ec80f
Browse repository at this point
Commits on Aug 6, 2024
#1172 问题的解决 (#1173)
Show description for 2c135da
blanexie
and
xiezhicheng
authored
2c135da
View commit details
Copy full SHA for 2c135da
Browse repository at this point
Commits on Jul 4, 2024
Update for next development version
sutra
committed
25c2d95
View commit details
Copy full SHA for 25c2d95
Browse repository at this point
Merge branch 'release/1.0.0'
sutra
committed
9d75cce
View commit details
Copy full SHA for 9d75cce
Browse repository at this point
Merge tag 'WebMagic-1.0.0' into develop
Show description for c88330f
sutra
committed
c88330f
View commit details
Copy full SHA for c88330f
Browse repository at this point
Update versions for release
sutra
committed
3e9cd9b
View commit details
Copy full SHA for 3e9cd9b
Browse repository at this point
Commits on Jun 17, 2024
stopWhenComplete,增加动态修改完成时停止方法。 (#1169)
Show description for 4d0cdb0
niuxiaozu
and
niuxiaozu
authored
4d0cdb0
View commit details
Copy full SHA for 4d0cdb0
Browse repository at this point
Commits on Jun 3, 2024
Add a private constructor to hide the implicit public one.
sutra
committed
49a5eff
View commit details
Copy full SHA for 49a5eff
Browse repository at this point
Previous
Next
You can’t perform that action at this time.