256 Kilobytes

Scripting and Automation

Type All Category Scripting and AutomationInformation and discussion of scripting of various types. Tag All

Profile Photo - August R. Garcia

Spit in the Face of God: Five Tasks You Didn’t Know Could be Done with Google Sheets

Articles in Spreadsheets | By August R. Garcia

Published 11 months agoTue, 12 Feb 2019 07:53:13 -0800 | Last update 10 months agoThu, 28 Feb 2019 22:37:26 -0800 📌

Profile Photo - Hash Brown

Last Reply Any opportunity to spit in the face of god is good by me. Excellent post homie.  Hash Brown,

Any opportunity to spit i...

Mon, 27 May 2019 07:59:54 -0700 7 months ago
🗨
2
🐏
2
👁
2,150
Profile Photo - Hash Brown

An introduction to scraping with Python and BeautifulSoup

Articles in Web Scraping, Data Analysis | By Hash Brown

Published 1 year agoTue, 08 Jan 2019 22:34:09 -0800 | Last update 10 months agoMon, 11 Mar 2019 22:19:33 -0700 📌

Profile Photo - August R. Garcia

Last Reply Very nice, as they say. Other scraping methods For those who don’t perhaps have the skills needed to code something there are also other... August R. Garcia,

Very nice, as they say.

Wed, 09 Jan 2019 03:16:31 -0800 1 year ago
🗨
1
🐏
1
👁
1,597
Profile Photo - Some Guy

Fix "typeerror: 'module' object is not callable"?

Answers in Scripting and Automation | By Some Guy

Published 1 year agoSun, 16 Dec 2018 09:37:24 -0800

Profile Photo - August R. Garcia

Last Reply This error is likely occurring because of code that involves a module that contains a function that has the same name as the module. For example, the... August R. Garcia,

This error is likely occu...

Tue, 31 Dec 2019 10:29:43 -0800 3 weeks ago
🗨
2
🐏
0
👁
178
Profile Photo - Some Guy
Profile Photo - August R. Garcia

Last Reply If there are some scenarios where the value is actually not intended to be a number, this can also be solved with a try-catch block: try: #... August R. Garcia,

If there are some scenari...

Tue, 03 Dec 2019 13:33:18 -0800 1 month ago
🗨
2
🐏
0
👁
5,584
Profile Photo - Some Guy
Profile Photo - August R. Garcia

Last Reply It's possible that if you have an array of values that you believe to be integers, that at some point they were converted to floats. Try printing out... August R. Garcia,

It's possible that if you...

Mon, 11 Nov 2019 08:22:53 -0800 2 months ago
🗨
1
🐏
0
👁
926
Profile Photo - August R. Garcia
Profile Photo - August R. Garcia

Alternatively "TypeError: %o format: an...

MoreThis is technically a different error message, but is what was causing the issue. string = "The value is one hundred (100)." # Raises an error...
🗨
0
🐏
0
👁
87
Profile Photo - August R. Garcia
Profile Photo - August R. Garcia

TFW

MoreSee code. Yeah, it seems like you do in fact have to make a bunch of additional HTTP requests. def resolve_t_co(t_co_url): if t_co_url !...
🗨
0
🐏
1
👁
130
Profile Photo - Some Guy
Profile Photo - August R. Garcia

Last Reply What the fuck is this question. This is like eight different errors. The answer is probably to cast something as something else. Look at this thread:... August R. Garcia,

What the fuck is this que...

Thu, 17 Oct 2019 14:04:45 -0700 3 months ago
🗨
1
🐏
0
👁
179
Profile Photo - Some Guy
Profile Photo - August R. Garcia

Last Reply Cast the integer to be a string. # Probably something like this is causing the error x = 3 text = "whatever" # "TypeError: unsupported op... August R. Garcia,

Cast the integer to be a...

Thu, 17 Oct 2019 14:03:15 -0700 3 months ago
🗨
2
🐏
0
👁
1,816
Profile Photo - August R. Garcia
Profile Photo - August R. Garcia

It's time to post code so that I can fin...

MoreIt's time to post code so that I can find this the next eight times I need to do this: # ##### ##### ################# ##### ##### # # ##### ###...
🗨
0
🐏
0
👁
97
Profile Photo - August R. Garcia
Profile Photo - August R. Garcia

Last Reply Here's a better version that removes the " results" string and then casts the result to a number instead of a string: =VALUE(substitute(importXML... August R. Garcia,

Here's a better version t...

Tue, 08 Oct 2019 09:17:50 -0700 3 months ago
🗨
1
🐏
0
👁
240
Profile Photo - August R. Garcia

[Solved] Python - Getting the remote/server IP address and port from an HTTP response using the requests library?

Answers in Web Scraping, Data Analysis | By August R. Garcia

Published 4 months agoWed, 25 Sep 2019 15:54:55 -0700 | Last update 3 months agoThu, 26 Sep 2019 13:25:27 -0700

Profile Photo - August R. Garcia

Some edge case what even is this.

MoreThe solution here seems to generally work: https://stackoverflow.com/questions/22492484/how-do-i-get-the-ip-address-from-a-http-request-using-th...
🗨
0
🐏
0
👁
324
Profile Photo - August R. Garcia

How to Make a Simple, Automatically-Updating Dashboard for Python Scripts Using HTML, JavaScript, and JSONP

Articles in Scripting and Automation | By August R. Garcia

Published 4 months agoThu, 05 Sep 2019 04:39:30 -0700 | Last update 4 months agoThu, 05 Sep 2019 05:15:22 -0700

Profile Photo - Default

Last Reply Thank you for the post. Blogger at Radio Box https://www.youtube.com/watch?v=Jfh_qbzhUKI RadioBox,

Thank you for the post.

Sat, 21 Sep 2019 04:07:21 -0700 4 months ago
🗨
2
🐏
1
👁
523
Profile Photo - August R. Garcia
Profile Photo - August R. Garcia

Currently: Python, Bash

MoreSee: Correct Horse Battery Staple from XKCD, if somehow you haven't seen this before. There's also a generator that can be used here. How to...
🗨
0
🐏
1
👁
151
Profile Photo - August R. Garcia

[Solved] How to Get Random Punctuation in Python

Answers in Scripting and Automation | By August R. Garcia

Published 4 months agoMon, 16 Sep 2019 19:14:26 -0700

Profile Photo - August R. Garcia

Code:

MoreCode: # string.punctuation contains the following characters: # !"#$%&'()*+,-./:;<=>?@[\]^_`{|}~ import random, string print( rand...
🗨
0
🐏
0
👁
144
Profile Photo - August R. Garcia

[Solved] How to immediately kill all Python threads when working with multithreading

Answers in Scripting and Automation | By August R. Garcia

Published 4 months agoSun, 15 Sep 2019 17:06:46 -0700 | Last update 4 months agoSun, 15 Sep 2019 20:49:11 -0700

Profile Photo - August R. Garcia

why is this answer so hard to find

MoreNormally, to kill a Python script while it is running, pressing CTRL+C will work. However, if there are multiple threads running because the program i...
🗨
0
🐏
0
👁
837
Profile Photo - August R. Garcia

[Solved] Color code HTTP status codes in Python

Answers in Web Scraping, Data Analysis | By August R. Garcia

Published 5 months agoMon, 29 Jul 2019 22:34:12 -0700

Profile Photo - August R. Garcia

Last Reply For Python 3: import http.client [...] try: msg = " " + http.client.responses[status_code] [...] Code is basically th... August R. Garcia,

For Python 3:

Mon, 09 Sep 2019 12:10:10 -0700 4 months ago
🗨
1
🐏
0
👁
252
Profile Photo - Some Guy

Solve "Typeerror: unhashable type: 'list'"?

Answers in Scripting and Automation | By Some Guy

Published 1 year agoSun, 16 Dec 2018 09:34:42 -0800

Profile Photo - August R. Garcia

Last Reply Ran into this like five minutes ago and found this fucking thread in the SERPs. What a shitty fucking thread that did not answer my question. Anyway,... August R. Garcia,

Ran into this like five m...

Thu, 05 Sep 2019 07:50:44 -0700 4 months ago
🗨
2
🐏
0
👁
529
Profile Photo - August R. Garcia

The Basics to Web Scraping with cURL and XPath

Articles in Web Scraping, Data Analysis | By August R. Garcia

Published 6 months agoFri, 28 Jun 2019 09:02:04 -0700 | Last update 6 months agoTue, 02 Jul 2019 17:37:33 -0700

Profile Photo - August R. Garcia

Last Reply Bump. Some more cURL, used to determine the quality of proxygo's proxies: for i in {1..48} ; do curl https://www.blackhatworld.com/seo/ssl-proxi... August R. Garcia,

Bump. Some more cURL, use...

Thu, 29 Aug 2019 18:31:09 -0700 4 months ago
🗨
4
🐏
2
👁
4,733
Profile Photo - August R. Garcia

[Solved] Basic progress bar functionality with Python

Answers in Scripting and Automation | By August R. Garcia

Published 5 months agoSun, 25 Aug 2019 12:04:00 -0700 | Last update 5 months agoSun, 25 Aug 2019 12:06:08 -0700

Profile Photo - August R. Garcia

Commentary is hard. Use your reading ski...

MoreCommentary is hard. Use your reading skills to read this code: #!/usr/bin/env python # -*- coding: utf-8 -*- import time import sys from...
🗨
0
🐏
0
👁
159
Profile Photo - August R. Garcia

[Solved] How to Show Number of Remaining Threads in Python

Answers in Scripting and Automation | By August R. Garcia

Published 5 months agoFri, 16 Aug 2019 06:38:19 -0700 | Last update 5 months agoMon, 26 Aug 2019 01:21:58 -0700

Profile Photo - August R. Garcia

Self explanatory, mostly.

MoreSelf explanatory, mostly. Original Code import Queue from threading import Thread, active_count import time que = Queue.Queue()...
🗨
0
🐏
0
👁
164
Profile Photo - August R. Garcia
Profile Photo - August R. Garcia

The answer is to fucking kill yourself.<...

MoreThe answer is to fucking kill yourself.
🗨
0
🐏
0
👁
191
Profile Photo - August R. Garcia

[Solved, Basically] Nautilus - Open Multiple Tabs from Command Line?

Answers in Shell Scripting | By August R. Garcia

Published 6 months agoSat, 20 Jul 2019 23:22:36 -0700 | Last update 6 months agoSat, 20 Jul 2019 23:22:46 -0700

Profile Photo - August R. Garcia

How to open multiple GUI file manager ta...

MoreThe answer is that there's no built in option to do this in Nautilus, although there are Stack Exchange threads discussing ghetto hack workarounds....
🗨
0
🐏
2
👁
195
Profile Photo - August R. Garcia

[BASH, cURL] Yellow Pages Scraper: Fully Functional Script with Source Code

Articles in Web Scraping, Data Analysis | By August R. Garcia

Published 6 months agoFri, 05 Jul 2019 23:22:06 -0700 | Last update 6 months agoSat, 06 Jul 2019 01:44:02 -0700

Profile Photo - August R. Garcia

What a nice, free YellowPages scraper.

MoreEdit: When trying to scrape indefinitely (~100+ pages), there's some buggy behavior with exit conditions currently. If/when an updated script is poste...
🗨
0
🐏
1
👁
404
Profile Photo - August R. Garcia

Downloading Bulk Images: ThisPersonDoesNotExist with Python and urllib2

Articles in Web Scraping, Data Analysis | By August R. Garcia

Published 10 months agoThu, 14 Mar 2019 06:25:36 -0700 | Last update 10 months agoThu, 14 Mar 2019 08:05:08 -0700

Profile Photo - August R. Garcia

Last Reply Here's a shorter version with cURL and BASH that does basically the same thing: for i in $( seq 1 10 ) ; do curl --user-agent "Some User-Agent St... August R. Garcia,

Here's a shorter version...

Thu, 04 Jul 2019 12:56:36 -0700 6 months ago
🗨
2
🐏
0
👁
3,656
Profile Photo - August R. Garcia

[cURL, BASH] How to Crawl and Scrape DuckDuckGo Search Results

Articles in Web Scraping, Data Analysis | By August R. Garcia

Published 6 months agoTue, 02 Jul 2019 17:29:24 -0700 | Last update 6 months agoThu, 04 Jul 2019 19:21:52 -0700

Profile Photo - August R. Garcia

You can use these same concepts to build...

MoreAs discussed recently, it is relatively easy to scrap various arbitrary pieces of data using cURL (and XPath). You can use these same concepts to buil...
🗨
0
🐏
1
👁
1,073
Profile Photo - Some Guy

The Easiest Way to Build a Reddit Bot?

Forum in Scripting and Automation | By Some Guy

Published 1 year agoSun, 16 Dec 2018 09:40:29 -0800 | Last update 6 months agoSun, 30 Jun 2019 14:54:21 -0700

Profile Photo - August R. Garcia

Last Reply Also, see this post. Could probably do something similar, depending on use case: https://www.256kilobytes.com/content/show/10842/the-basics-to-w... August R. Garcia,

Also, see this post. Coul...

Sun, 30 Jun 2019 14:54:58 -0700 6 months ago
🗨
2
🐏
0
👁
306
Profile Photo - Some Guy
Profile Photo - Univa

Last Reply A simple case that generates this error message: In [8]: [1,2,3,4,5][np.array([1])] --------------------------------------------------------------... Univa,

A simple case that genera...

Sat, 01 Jun 2019 09:14:49 -0700 7 months ago
🗨
1
🐏
0
👁
388
Profile Photo - Some Guy

[Google Sheets] Dollar sign usage? What does it do?

Answers in Spreadsheets | By Some Guy

Published 11 months agoWed, 06 Feb 2019 14:35:22 -0800

Profile Photo - Univa

Last Reply The $ is used in a cell reference to create an absolute reference. An absolute reference is one that will not change when the formula is copied. Th... Univa,

The $ is used in a cell r...

Fri, 31 May 2019 10:47:38 -0700 7 months ago
🗨
2
🐏
0
👁
296
Profile Photo - Some Guy
Profile Photo - Univa

Last Reply In case you get this error it might also be related to how you included the javascript file into your html page. When loading modules you have to expl... Univa,

In case you get this erro...

Sun, 26 May 2019 10:46:17 -0700 7 months ago
🗨
1
🐏
0
👁
291