Computer Productivity Hacks

Command Line

• Manage Network Tasks From the Windows Command Prompt

Mounting shared drives and connecting to remote resources is something you can easily do from the Windows GUI. With our quick guide to the command prompt, however, you can more easily automate large tasks.

• Command Line Crash Course

Quick super fast course in using the command line. It is intended to be done rapidly in about a day or two, and not meant to teach you advanced shell usage.

WGET

• How to download files from command line in Windows, like Wget is doing?

Using PowerShell (Among other useful options listed at this resource.):

• WinWGet

WinWGet is a GUI (Graphical User Interface) for Wget. It is FREE. It will keep track of your downloads - add, clone, edit, delete jobs.

• Wget for Windows
• WGET for Windows (win32) (Windows executable file.)

GNU Wget is a free network utility to retrieve files from the World Wide Web using HTTP and FTP, the two most widely used Internet protocols. It works non-interactively, thus enabling work in the background, after having logged off.

• Geek to Live: Mastering Wget

Say you want to backup your blog or create a local copy of an entire directory of a web site for archiving or reading later. The command: wget -m http://website.tld

• More advanced wget usage

Tips for mirroring specific directories, update only changed files, etc.

• cliget (A Firefox add-on.)

Download files using curl or wget. This addon generates curl/wget commands that emulate the request as though it's coming from your browser allowing you to download protected files directly to a separate machine (e.g. server).

Windows Command Line

• A Task-Based Guide to Windows PowerShell Cmdlets

Cmdlets are the heart-and-soul of Windows PowerShell, Microsoft's latest command shell/scripting language.

• Microsoft DOS robocopy command

Robocopy: A robust file copy command for the Windows command line.

• An A-Z Index of the Windows CMD command line

Each command is linked to more info about the particular command.

• Xcopy

The xcopy command is a Command Prompt command used to copy one or more files and/or folders from one location to another location.

Generate File List

• How can one extract the names of files in a folder as text?

Example: C:\Users\me\Downloads\MyFolder> dir /b > filelist.txt

(The text in orange shows the command used once you've navigated into the directory from which you want to generate the list of file names.)

• A PowerShell script to list all files and folders within a directory

This tutorial contains several working answers for using Windows PowerShell to list files and folders.

• How to get a list of sub-folders and their files, ordered by folder-names

Works with cmd.exe, but doesn't seem to work with Windows PowerShell.

Rename Files & Folders

• Rename Multiple Files Efficiently Using Excel or Google Docs

To rename files in bulk more efficiently, you can either learn some complex shell scripting language (SED, AWK, Perl) or switch to something more simple--a spreadsheet.

Bulk Rename Files

• How to Batch Rename Files in Windows: 4 Ways to Rename Multiple Files

Bottom line: use this tool: Bulk Rename Utility (Windows only.)

• Confused by Bulk Rename Utility? Take a look at Massive File Renamer instead.

Rename List of Files With Batch File

It's easy to rename a group of files by running a batch file (file.bat), configured something like this:

rename "Old-File_001.jpg" "New-File_001.jpg"
rename "Old-File_002.jpg" "New-File_002.jpg"
rename "Old-File_003.jpg" "New-File_003.jpg"

Using Windows or DOS, just create your batch file using the format shown above, and then double-click it to rename the files in the directory containing both your file.bat and files with the same names as those found in the "Old-File" (left) column of your file.bat file.

• How do I create batch file to rename large number of files in a folder?

See this answer: http://stackoverflow.com/a/3808074

For help with using Regular Expressions in text file, see this answer: Regular expresion in text editor (sic)

Rename Multiple Folders / Directories With Batch File

• .bat file for renaming multiple folders

There are a couple of pretty good answers to this question; answers that explain how the regular expression written into the .bat file actually works.

File Transfer

File Transfer Clients for Windows Mac

• OpenSSH Mac OS

Lists several clients recommended for interoperating with OpenSSH from Mac OS machines. Note that Mac OS X includes OpenSSH by default.

• SSH Clients for Windows and Mac

SSH Clients for Windows, Mac, and Unix

• Cyberduck

Libre FTP, SFTP, WebDAV, S3 & OpenStack Swift browser for Mac and Windows.

Folder & File Compression

• How to Use 7Zip to Create Multiple Compressed Folders in One Go

Example: for /d %%X in (*) do "c:\Program Files\7-Zip\7z.exe" a "%%X.zip" "%%X\"

• Batch file : Compress folder or file using windows compress

To compress a folder without using any particular compression software.

Getting screenshots from a Mac.

Print Screen / Screen Grabs / Screen Shots

• Print Screen

In Microsoft Windows, pressing Prt Scr will capture the entire screen, while pressing the Alt key in combination with Prt Scr will capture the currently selected window.

Using Ubuntu Linux

• Shutter for Ubuntu similar to Windows Snipping Tool

Using Mac OS

• Alternative to Windows Snipping Tool for Mac OSX
• Taking Screenshots is a Snap

Using Windows

• Snipping Tool

Regular Expressions

• Regular expression (Wikipedia)

In theoretical computer science and formal language theory, a regular expression (abbreviated regex or regexp and sometimes called a rational expression) is a sequence of characters that forms a search pattern, mainly for use in pattern matching with strings, or string matching, i.e. "find and replace"-like operations.

RegEx Tutorials

• Regular Expressions Tutorial: Learn How to Use and Get The Most out of Regular Expressions

Any non-trivial regex looks daunting to anybody not familiar with them. But with just a bit of experience, you will soon be able to craft your own regular expressions like you have never done anything else.

RegEx Tools

• Regex101: Online regex tester and debugger: JavaScript, Python, PHP, and PCRE

Regex101 allows you to create, debug, test and have your expressions explained for PHP, PCRE, JavaScript and Python. The website also features a community where you can share useful expressions.

• RegExr: Learn, Build, & Test RegEx

Regular expression tester with syntax highlighting, contextual help, video tutorial, reference, and searchable community patterns.

• Pythex: a Python regular expression editor

Pythex is a real-time regular expression editor for Python, a quick way to test your regular expressions.

• Regex Tester

JavaScript regex tester. Highlights matches on the fly.

Text Editors

• Mac text/code editor

Text Extraction

PDF Conversion

• pdftotext.org

pdftotext.org is the best online service for easily extracting text from your PDF files. Conversion from PDF to TXT is really fast thanks to our in-browser conversion architecture. Your PDF files are never uploaded to the Internet, so even private PDF files are safe to convert with this service. The conversion is done locally in your browser – you can even convert when you are offline! There is no need for any registration or sign-up, and the service will always be free to use.

• pdf2htmlEX

Convert PDF to HTML without losing text or format.

• PDF TEXT Extraction

Lists several options.

• Capture2Text

Capture2Text enables users to do the following:

1. Optical Character Recognition (OCR)
2. Speech Recognition

• SILVERCODERS DocToText

Extracts plain text from documents in all popular formats.

• Detexter

Detexter is an app designed to extract text from PDF files.

Data Scrape

• Almost Scraping: Web Scraping for Non-Programmers

Tools and tips compiled by journalists from PBS and Omaha World-Herald.

• Open Source at Scrapinghub

Scrapinghub's list of open source scraping projects.

• Sitestalker

Monitor website links with ease. Sitestalker supervises websites and notifies you when your desired content hits the web.Stop wasting your time constantly refreshing websites.

Sitestalker is great for:

Finding jobs

Searching for an apartment

Getting the best bargains

Clipping

• Six tools for web scraping – To use for data journalism & creating insightful content

Tools for gathering data from public sources.

Text Search

• geekDadaji - A SEARCH INITIATIVE

Makes tools to search text content, including:

1. FALCON - Text Search Java Project: JSON based text search Java Project
2. HAWK - PDF Text Search Java Project: Taking initiative for Document Text Search

• Xpdf: A PDF Viewer for X

Xpdf is an open source viewer for Portable Document Format (PDF) files.

Windows installer: Short Programs/Scripts (Look for the xpdf3.exe / poppler.exe links in left sidebar.)

Educate Yourself

Learn to Code

• The Best Websites to Learn Coding Online - Amit Agarwal, Digital Inspiration, Jan 12 2015

The Learn to Code movement has picked up momentum worldwide and that is actually a good thing as even basic programming skills can have a major impact. If you can teach yourself how to write code, you gain a competitive edge over your peers, you can think more algorithmically and thus can tackle problems more efficiently.

• New Year’s Resolution: Learn to Code - by Lena Groeger, ProPublica, Dec. 19, 2012, 2:51 p.m.

Lena Groeger: When I started learning to code, I was amazed by how much was out there: introductory videos, explanatory blog posts, tips and tricks and step-by-step guides. If you're a journalist who wants to make a news app or a student interested in learning to code, you have plenty of paths to choose from.

Multiple Codes

• Codecademy

Learn to code while building a project. Free online courses include: HTML & CSS; jQuery; JavaScript; PHP; Python; Ruby; Web Projects; APIs

R

• DataCamp

Learn R & Become a Data Analyst

D3.js

• d3Vienno

d3Vienno features a series of video tutorials, each about 10-12 minutes long, on using D3.js.

• Interactive Data Visualization for the Web: An Introduction to Designing with D3

D3 Tools

• SVG Crowbar

A Chrome-specific bookmarklet that extracts SVG nodes and accompanying styles from an HTML document and downloads them as an SVG file—A file which you could open and edit in Adobe Illustrator, for instance. Because SVGs are resolution independent, it’s great for when you want to use web technologies to create documents that are meant to be printed (like, maybe on newsprint). It was created with d3.js in mind, but it should work fine no matter how you choose to generate your SVG.

Data Analysis Tools

• D3.js - Data-Driven Documents

D3.js is a JavaScript library for manipulating documents based on data. D3 helps you bring data to life using HTML, SVG and CSS. D3’s emphasis on web standards gives you the full capabilities of modern browsers without tying yourself to a proprietary framework, combining powerful visualization components and a data-driven approach to DOM manipulation.

• Download RStudio

Take control of your R code. RStudio is the premier integrated development environment for R. It is available in open source and commercial editions and runs on the desktop (Windows, Mac, and Linux) or over the web with RStudio Server. Download RStudio (for Windows, Mac, or Linux).

• OpenRefine (Formerly Refine.)

Open Refine is a standalone open source desktop application for data cleanup and transformation to other formats, the activity known as data wrangling. It is similar to spreadsheet applications (and can work with spreadsheet file formats), however, it behaves more like a database.

• Data Wrangler (Stanford Visualization Group)

Wrangler allows interactive transformation of messy, real-world data into the data tables analysis tools expect. Export data for use in Excel, R, Tableau, Protovis, ...

• HTSQL—A Database Query Language

HTSQL is designed for data analysts and other accidental programmers who have complex business inquiries to solve and need a productive tool to write and share database queries. HTSQL is free and open source software.

• Jigsaw: Visual Analytics for Exploring and Understanding Document Collections

Jigsaw is a visual analytics system to help analysts and researchers better explore, analyze, and make sense of such document collections.

Investigative Reporting; Journalism; General Research

• Investigative Reporters and Editors (IRE)

Useful IRE Resources:

- NICAR Net Tour - The National Institute for Computer-Assisted Reporting (NICAR) is an IRE program.

- Analysis jobs by NICAR - Names the media organizations NICAR has worked for, and lists kinds of analysis jobs NICAR has done.

Maintenance

Dual Boot

• Dual-Boot Windows 7 and Ubuntu in Perfect Harmony

Boot Disks

• How to Boot From a CD or USB Drive on Any PC

• Rufus

Rufus is an utility that helps format and create bootable USB flash drives, such as USB keys/pendrives, memory sticks, etc.

Network Issues

• Local Area Network : How to fix slow LAN transfer speed of files in Windows

Post reviews various "fixes" found all over the web, and which "fix" actually worked for the post's author.

• Change your MTU under Vista, Windows 7 or Windows 8

Path MTU Discovery (PMTUD) in Windows just doesn’t seem to figure out the MTU for a given path. So Windows uses the default. For the most part this doesn’t affect anyone. But failure of PMTUD will result in some websites not loading correctly, having trouble connecting to normally reliable online services and general Internet weirdness.

See Also

• Office Productivity Hacks
• Spreadsheet Tricks
• Social Networking Tips
• User:Dave/Web Hack Notes (Non-Wiki)