Many members of parliament.uk choose to host their websites outside of the UK (or blindly follow their political parties choice of provider), I look at who they are.
SLOG of Carl Heaton Posts
As the subject suggests after parsing parliament.uk for a list of all MP websites and twitter accounts, I performed DNS queries against each websites domain…
I needed to get a list of all websites for UK members of parliament and have it update reasonably frequently / ability to repeat.
http://www.parliament.uk/mps-lords-and-offices/mps/ lists all the current members so a simple PHP script was written using http://simplehtmldom.sourceforge.net/ to parse the list of members, fetch each member profile and parse the name, website and twitter handles.
This script in all it’s hackyness may be found below (best run via php-cli to minimise timeout or memory issues) and example output at http://slog.carlheaton.co.uk/list-of-all-uk-members-of-parliament-name-website-twitter-handle/
Parsed contents of http://www.parliament.uk/mps-lords-and-offices/mps/ to CSV for name, website, twitter as of 2016/11/11.
Sometimes you just want to check the performance of a website or asset over a short period of time to get a general idea if it is performing normally. The bash script below simplifies that by calling curl with performance counter output formatting, wait and recursion. Tested on CentOS7 (and Ubuntu 14.0.4).
There are several vbulletin communities to which I am member and long term contributor, where there is a risk these contributions may go offline / be lost as people move on to other things, so I make infrequent private mirrors/copies for this purpose (copyright implications considered) with the following wget cookie method.