 Kasianov Nikolai Alekseevich
|
812fd2adf7
|
Moved up until now separate text saving code to the worker package where it should be
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
b256d8a83e
|
No more unified text output file. Text searches of different kinds go into their own files
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
e5af2939cc
|
Web dashboard: ability to change runtime query
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
6fab9031b1
|
Web dashboard foundation
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
fd484c665e
|
Documents search
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
00bc33d5de
|
Updated README
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
f96bad448a
|
Removed debug logging from visit queue functions
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
d877a483a2
|
In-file memory queue! No more insane RAM consumption
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
023c2e5a19
|
Removed forgotten pprof stuf
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
1771d19b82
|
Added new information to README
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
5150edc41c
|
Real pages/sec calculation and output
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
d4888dab92
|
Bumped data channels capacity
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
793c2b2a70
|
HUGE FIX: partially fixed abnormal memory consumption via actually closing http connections; Side-effect: no more what I thought was "bandwidth-throttling"
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
7dbf55cb32
|
extractData flag
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
963c3b3ca4
|
Better email address regexp; MX lookup check
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
d81f732b82
|
Removed links search; Added email search
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
91112b89ba
|
NO DEPENDENCIES !; Audio, and video search; separate timeout for file fetching
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
36b887f372
|
Fixed allowed domains being broken when an empty string was specified in the configuration file
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
b84af90d08
|
Fixed allowed_domains not being used
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
7fa094d80f
|
Fixed a terrible logical "bug" in worker`s Work function; Added comments; Added more image extentions; Merged and improved ResolveLink function
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
31f4b9e43e
|
Corrected README text
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
fc7f9f3c70
|
Fixed relative links not being resolved
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
766949edc5
|
Added version number
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
cd97a09460
|
make release and install
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
2d5cc84184
|
Better handling of image urls
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
5b14a88f95
|
Updated name in version flag output
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
f2c77e787e
|
Do not output the same images of the same page
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
7c30787990
|
Blacklisting domains
|
2 years ago |
|
Kasianov Nikolai Alekseevich
|
aa7e3c2683
|
Initial commit
|
2 years ago |
