right now I just want to just _see_ it at all lol

LOL

exactly

https://github.com/d3/d3 is a JS library that is designed for heavy duty graphs charting and data visualization

yea I've been using d3

but I don't think its meant to handle 90K-1.5M nodes

and even more edges

You'd ahve to do some massive filtering

yea without knowing what it looks like, I don't know what is safe to filter

Data optimization is a must...

@AntiFish03, you just advanced to level 1!

OK Gephi froze

Wow...

its doing a layout

so it makes sense lol

I just wish it was async and not so rude

and my latest svg is still running 40 mins 😦

Lol not everything can play as nice at async as Python ot JS

OK fine I'll do the clumping edge labeling

it results in small number of edges

Sadly, I don't have a lot of experience with data analysis... I mean my attempt at try to make an example at how simple it would be to hide code in a vote tabulator for someone is generally as far as I have to go, it's either data input or display of analyzed data.

https://codepen.io/antifish03/pen/wvWQjVE

It's nothing special and I put maybe an hour into it to prove what I was thinking. But it has no place around real data...

Not, that it couldn't be used as a trainer for an AI to look for similar style inconsistencies.

cool

gephi is still forzed

What's your resource monitor say?

it says Gephi is using 1 full core

6 G of RAM

and running very inefficiently w.r.t power 🙂

man that 500k edge graph is taking almost an hour to turn into an svg

OK I need a better way to visualize dot files

Can you do smaller chunks of the data and overlay the dots in layers?

@AntiFish03, you just advanced to level 2!

oh interesting idea

I can probably see how many connected graphs there are

It would let you still visualize the data but at smaller bite size pieces rather than choking on the whole thing at once

Since SVG is just a glorified XML file smaller ones can be merged with others into a bigger one

yea there is no need see the connected components together

I don't even need to merge it

lemme first see how many components there are