 Kasianov Nikolai Alekseevich
|
f96bad448a
|
Removed debug logging from visit queue functions
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
d877a483a2
|
In-file memory queue! No more insane RAM consumption
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
023c2e5a19
|
Removed forgotten pprof stuf
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
5150edc41c
|
Real pages/sec calculation and output
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
d4888dab92
|
Bumped data channels capacity
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
793c2b2a70
|
HUGE FIX: partially fixed abnormal memory consumption via actually closing http connections; Side-effect: no more what I thought was "bandwidth-throttling"
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
7dbf55cb32
|
extractData flag
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
963c3b3ca4
|
Better email address regexp; MX lookup check
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
d81f732b82
|
Removed links search; Added email search
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
91112b89ba
|
NO DEPENDENCIES !; Audio, and video search; separate timeout for file fetching
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
36b887f372
|
Fixed allowed domains being broken when an empty string was specified in the configuration file
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
b84af90d08
|
Fixed allowed_domains not being used
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
7fa094d80f
|
Fixed a terrible logical "bug" in worker`s Work function; Added comments; Added more image extentions; Merged and improved ResolveLink function
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
31f4b9e43e
|
Corrected README text
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
fc7f9f3c70
|
Fixed relative links not being resolved
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
766949edc5
|
Added version number
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
2d5cc84184
|
Better handling of image urls
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
5b14a88f95
|
Updated name in version flag output
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
f2c77e787e
|
Do not output the same images of the same page
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
7c30787990
|
Blacklisting domains
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
aa7e3c2683
|
Initial commit
|
2 years ago |
