Filtering 500K SEC Companies to Find Job Opportunities Using Claude AI

Instead of applying to the usual top 100 companies, this video filters over half a million SEC filings into a targeted list of lesser-known, funded companies to apply to.

2:23 video3 min readWatch on YouTube

Most job seekers apply to the same short list of well-known companies everyone else is already applying to. This video takes a different approach: instead of guessing which companies might be hiring, it filters more than 500,000 SEC Form D filings down to a targeted, lesser-known set of funded companies that job seekers can actually work through, and it uses Claude AI to write the filtering script in real time.

Show the AI your data first

The core technique demonstrated here is deceptively simple: before asking Claude to write a filtering script, paste in the actual JSON structure the script needs to work with, including a few real example entries. Skipping that step means the AI has to guess at the data's shape, which leads to a slow back-and-forth of trial, error, and re-explaining. Showing the real data upfront means the script has a much better chance of working on the first try, because the AI can see exactly what fields exist and how they're formatted rather than assuming.

Filtering by real criteria

The filtering criteria are practical and specific: a minimum funding amount of $1 million or more, geographic focus on states with strong tech hubs (Massachusetts, California, New York, Washington, Texas, and Illinois), and industry exclusions to cut out real estate, retail, restaurants, and pooled investment funds, none of which are likely to be hiring the kind of talent this list is meant to serve. The goal isn't a perfect dataset on the first pass, it's a workable one that gets refined as issues turn up.

Catching mistakes and fixing them fast

Running the first version of the script surfaces useful output almost immediately: companies across categories like biotech, healthcare, investing, financial, manufacturing, and pharmaceuticals. But it also surfaces a mistake, restaurants showing up in results they should have been excluded from. Rather than treating that as a major setback, the fix is treated as trivial: check whether the script is using a keyword list for exclusions, and if so, just add "restaurants" to that list and rerun it. The AI wrote the original script in about two seconds, so updating it takes about the same amount of time.

From filtered data to a usable file

The end goal isn't a clean spreadsheet for its own sake, it's something people can act on immediately. Once the filtering criteria are dialed in, probably one or two more refinement passes, the plan is to export everything into a CSV file that can go straight to job seekers, letting them start researching and applying to companies beyond the usual oversaturated top-tier names.

Key takeaways

  • Sharing your actual data format with an AI system before asking it to write a script avoids slow, repeated debugging cycles.
  • The filtering pipeline starts with roughly 568,707 SEC Form D filings and narrows toward a much smaller, targeted set.
  • Filtering criteria include a $1 million-plus funding threshold, specific tech-hub states, and exclusions for industries unlikely to hire this audience.
  • Iterative fixes, like adding a missed keyword such as "restaurants" to an exclusion list, take seconds to apply and rerun.
  • The final output is a CSV file meant to be used immediately by job seekers researching companies to apply to.

Who this is for

This video is part of the 80 Days to Stay project, an initiative from Humanitarians AI helping international students find companies capable of visa sponsorship before their OPT expires. It's a useful watch for anyone curious about practical AI-assisted data workflows, not just the job seekers the resulting list is built for, since the underlying lesson, give the AI your real data before asking it to write code, applies far beyond this one dataset.

Full transcript(auto-generated, with timestamps)

[0:01]Okay, bear here. I'm filtering down. We had something like half a million um companies. We need to make it more targeted. I'd like to get this to uh people today at least as a CSV pop uh because then people can start, you know, looking at companies that they may want to apply to, but not in the top 100 companies that they have been applying to. So, I just asked CL to take my JSON. I pasted in my JSON so it knew exactly what the JSON looked like. If you don't do that, it'll make mistakes. So you say write a script, but then show it the

[0:38]Data. Otherwise, you'll go back and forth forever with it making mistakes because it doesn't have the information it needs to write the script. So it was pretty simple. Just uh we'll see. I actually haven't tried the script yet. Uh we'll see if it works. But basically I said write a script to filter according to these criterion the ones that I talked about this morning. And I also at the same time posted like three or four entries in there. So I knew exactly how the data looked. So let's take a look and see if it works. Looks like it's running. No errors yet. Boom. There we go. So it gave us some

[1:18]Stats. Uh we have other technology other I'll have to look but they're probably okay can always filter down later biotech healthcare investing financial manufacturing pharmaceuticals the restaurants are wrong so uh what I just basically do is I am going to just say you know let's restaurants so with all AI um you know it's back and forth but it literally took two seconds to rent the script so it'll take another two seconds to have it update Uh, and this I can actually probably do myself. This is probably a filter list. First thing I'll do is I'll just look in the script and see, do they have a bunch

[1:57]Of keywords? And if so, I'll just add restaurants to the keywords and rerun it. Uh, so the next thing I'm going to do is have it once I do all my filtering, which is probably one or two more steps, um, I'm going to have it then formatted into a CSV file. So, I could literally send it to people in need and have them begin to use it. Okay, that's it.

More videos

Humanitarians AI Lyrical Literacy Project