Search This Blog

Showing posts with label python. Show all posts
Showing posts with label python. Show all posts

Wednesday, November 8, 2017

Python scripts for search engines.


https://pythonexample.com/
Search engine scripts, some are really useful. To be tested. And Copernicus for download information from social media. OSINT - Open Source Intelligence "Leading Intelligence and Investigation Technique"
New! Automatically Discover Website Connections Through Tracking Codes
http://www.automatingosint.com/blog/2017/07/osint-website-connections-tracking-codes/


Python examples Timeline

TitleDeveloperKeywordDescriptionDate
serializers.pyclearinterfaceserializers2017-11-08
python_ftp.pyclearinterfacepythonpython ftp code2017-11-08
api.pyclearinterfaceapi.py - p=1262017-11-08
http_request.pynhrwtrhttp requestHTTPの勉強2017-11-08
autowihtelaamalifautowihteauto white correction opencv2017-11-08
Queue.pybosskunqueueQueue2017-11-08
PyEx1.pyTestosterpwnpyex1PracticePython.org Exercise 1 + bonus objectives2017-11-08
DoublyLinkedList.pybosskunDoublyLinkedList2017-11-08
ghost_in_the_heap.pypeternguyen93ghost heap2017-11-08
dummy-web-server.pysherlockwudummy servera minimal http server in python. Responds to GET, HEAD, POST requests, but will fail on anything else.2017-11-08
PyEx2.pyTestosterpwnpyex2PracticePython.org Exercise 2 + bonus objectives2017-11-08
gcloud_bq_tables.pykrnrgcloud tablesexample of BigQuery tables creation2017-11-08
python-get-count-by-date.pydgadiraju2017-11-08
ytdl.pywDimChtzytdlPython script (GUI) to download YouTube videos (as video or audio).2017-11-08
guillet.pydcw32guilletGuillet Data2017-11-08
focus_group.pySumeniafocus groupfocus group2017-11-08
genie.pyminhtt159genieSvATTT2017 - Crypto22017-11-08
combine_images_vertically.pydaitecombine_images_vertically2017-11-08
jsreport.pyrylincolnjsreportpython jsreport batch2017-11-08
pair_checker.pychewingFpair checker2017-11-08

Saturday, September 30, 2017

Regular expression matching operations in programming

In programming to select and extract necessary information from website you can use regex or regular expression - symbolic logic to select or exclude information. In Python there is library Regular Expression Syntax, which explains syntax and present samples. Though it is complicated to understand and to write by himself even after searching Stackoverflow. So use search regex tutorial on Google. Search show to use website RegexOne Learn Regular Expressions with simple, interactive exercises. Interactive Tutorial and Regular expressions 101 Interactive website to read to understand and to practice regex. With regex you can write complex commands in Scrapy spider to extract only necessary information or you can process text file with regex also. Today I program integration of automatic solution for Facebook groups matching with their members number, which I have already developed. I found that Chrome Extension LinkKlipper has option to select text file for download with regex option. So I put /groups/ in regex field and LinkKlipper will download only those links which contain word 'groups' in it. Unecssary links with 'permalink' word will deleted automatically by python code, so for sake of simplity I avoid more complex regex syntax.