I think I can figure this out, though

@ThisIsChris I'm testing out my solution right now

In the meantime, I have some new ideas

How difficult do you think it would be to add this functionality? Detect what specific immigration topic is about, and automatically suggest counterarguments from a database.

Maybe I could put the arguments in a list, and look for phrases like "jobs Americans won't do" and the script would immediately pop out a refutation

I think it would be pretty straightforward. You need a list keywords/key phrases that indicate the topic of conversation, then you just need a pre-written counter argument for each topic

@Jacob "Maybe I could put the arguments in a list, and look for phrases like "jobs Americans won't do" and the script would immediately pop out a refutation" yeah exactly this

cool

This is gonna get pretty advanced

I'll see if I can make the script automatically run once a day and send me an email with pro-immigration comments and recommended counter arguments

@Jacob perfect MVP to work on. I look forward to seeing it

@ThisIsChris What's the point of searching comment_set over comment_text?

it just made comment_set.intersection({set of keywords}) simpler to write

Does
```
if {"immigrant", "immigration"}.intersection(comment_text)
```
work?

would that work for plurals?

comment_text is a string, so no

intersection is for sets

ah

so I can't check for certain phrases in order?

You can, look at the "white people" condition as an example

oh that's right

I just can't do it as an intersection

right

so, if I want to check for one out of a list of phrases, I just have to use ```and``` a lot?

I mean, I have a list of phrases, and I want to see if one of those phrases is in a comment

that is a straightforward way, a less verbose way would be:
```python
if any(key_phrase in my_string for key_phrase in list_of_phrases)
```

thanks

what do you guys think of DuckDuckGo? I'm sick of google

@Deleted User at first I was hesitant to use it because its owner and founder is a "you know who" but I find DDG gives different results from Google often so it's a good other source to check out. However, if you like Google results and are just worried about privacy then you can use startpage.

@ThisIsChris Any idea why the script skips over some comments?

https://redditsearch.io

If I use this, it shows comments that the script didn't find

@Jacob you could be being rate limited. Instead of silently handling the JSONDecodeError try printing the error to see what's happening. One thing you can do to mitigate is add
```python
import time
time.sleep(4)
```

I did try that

Into the while loop

but I think it misses a lot of comments, no?

I did time.sleep() with .5, 1, and 2

Try 4

That's the documented rate limit

Wouldn't 4 seconds be enough for a lot of comments to be posted?

Also I think the rate limit is actually 1 request every 2 seconds