SkyGraph
@skygraph.art
Layered community detection, built on old gaming PC for fun, art and feeds by @witch.monster.
https://skygraph.art
Visualization of communities based on @jaz.bsky.social's Atlas
⚫->🟢->🟠->🟣->🔵
Opt out: @optout.skygraph.art
https://skygraph.art
Visualization of communities based on @jaz.bsky.social's Atlas
⚫->🟢->🟠->🟣->🔵
Opt out: @optout.skygraph.art
SkyGraph.art
It's the graph from June 2024 when there was only 5 million blueskies. Unfortunately, it's not being updated anymore since I can't afford a supercomputer to collect all the data from 20+ mil users
It's the graph from June 2024 when there was only 5 million blueskies. Unfortunately, it's not being updated anymore since I can't afford a supercomputer to collect all the data from 20+ mil users
SkyGraph.art
December 12, 2024 at 5:03 AM
SkyGraph.art
It's the graph from June 2024 when there was only 5 million blueskies. Unfortunately, it's not being updated anymore since I can't afford a supercomputer to collect all the data from 20+ mil users
It's the graph from June 2024 when there was only 5 million blueskies. Unfortunately, it's not being updated anymore since I can't afford a supercomputer to collect all the data from 20+ mil users
yes, current load is making it impossible for me to generate datasets on current equipment
Well, this is probably it.
But there's hope.
All the code is here:
github.com/witchmonster...
github.com/witchmonster...
github.com/witchmonster...
Feel free to reach out to @witch.monster if you need any advice on setting it up.
But there's hope.
All the code is here:
github.com/witchmonster...
github.com/witchmonster...
github.com/witchmonster...
Feel free to reach out to @witch.monster if you need any advice on setting it up.
sorry, after Brazil joined, feeds probably won't go up again. all my indexers are down.
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
October 23, 2024 at 3:33 PM
yes, current load is making it impossible for me to generate datasets on current equipment
I've been somewhat successful in getting official Discover showing me about 80% relevant stuff using "show less"/"show more". 10-20% is still random posts though.
the clustering there still doesn't look flexible enough to make everyone happy, but it's much improved.
hope that helps 🙏
the clustering there still doesn't look flexible enough to make everyone happy, but it's much improved.
hope that helps 🙏
October 18, 2024 at 8:52 PM
I've been somewhat successful in getting official Discover showing me about 80% relevant stuff using "show less"/"show more". 10-20% is still random posts though.
the clustering there still doesn't look flexible enough to make everyone happy, but it's much improved.
hope that helps 🙏
the clustering there still doesn't look flexible enough to make everyone happy, but it's much improved.
hope that helps 🙏
I'm sure skygaze.io is gone for the same reason. they had the funding, but couldn't figure out business model to justify burning this much of electricity
October 18, 2024 at 8:22 PM
I'm sure skygaze.io is gone for the same reason. they had the funding, but couldn't figure out business model to justify burning this much of electricity
they're gone, unfortunately
our server couldn't handle the load (solvableish) and the size of the dataset (solvable only if you're a startup with good funding, not a pet project)
our server couldn't handle the load (solvableish) and the size of the dataset (solvable only if you're a startup with good funding, not a pet project)
October 18, 2024 at 8:20 PM
they're gone, unfortunately
our server couldn't handle the load (solvableish) and the size of the dataset (solvable only if you're a startup with good funding, not a pet project)
our server couldn't handle the load (solvableish) and the size of the dataset (solvable only if you're a startup with good funding, not a pet project)
state at the moment: not enough resources to handle the current load.
possible future solutions:
1) getting more funding (not happening, it's a hobby project, not a startup)
2) other team with more resources will pick up the work since everything is open source
possible future solutions:
1) getting more funding (not happening, it's a hobby project, not a startup)
2) other team with more resources will pick up the work since everything is open source
Well, this is probably it.
But there's hope.
All the code is here:
github.com/witchmonster...
github.com/witchmonster...
github.com/witchmonster...
Feel free to reach out to @witch.monster if you need any advice on setting it up.
But there's hope.
All the code is here:
github.com/witchmonster...
github.com/witchmonster...
github.com/witchmonster...
Feel free to reach out to @witch.monster if you need any advice on setting it up.
sorry, after Brazil joined, feeds probably won't go up again. all my indexers are down.
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
September 19, 2024 at 9:46 PM
state at the moment: not enough resources to handle the current load.
possible future solutions:
1) getting more funding (not happening, it's a hobby project, not a startup)
2) other team with more resources will pick up the work since everything is open source
possible future solutions:
1) getting more funding (not happening, it's a hobby project, not a startup)
2) other team with more resources will pick up the work since everything is open source
SkyGraph is dead until further notice 😭
sorry, after Brazil joined, feeds probably won't go up again. all my indexers are down.
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
September 15, 2024 at 2:01 PM
SkyGraph is dead until further notice 😭
Good luck pioneers.
Keep that Ficsit property safe.
Keep that Ficsit property safe.
September 10, 2024 at 3:24 PM
Good luck pioneers.
Keep that Ficsit property safe.
Keep that Ficsit property safe.
that's 100% what I'll be up to for the next month or two.
so don't ask me 😅
so don't ask me 😅
September 8, 2024 at 4:24 PM
that's 100% what I'll be up to for the next month or two.
so don't ask me 😅
so don't ask me 😅
I hate to break the news: Satisfactory 1.0 releases on Tuesday.
You have 2 days to wrap it up, folks.
You have 2 days to wrap it up, folks.
September 8, 2024 at 4:17 PM
I hate to break the news: Satisfactory 1.0 releases on Tuesday.
You have 2 days to wrap it up, folks.
You have 2 days to wrap it up, folks.
Why is it so? Well, just a math major gut feeling. later confirmed by my friend who reminded me that even Dijkstra is not streamable, which is an easy graph traversal algorithm compared to Leiden.
September 7, 2024 at 1:55 PM
Why is it so? Well, just a math major gut feeling. later confirmed by my friend who reminded me that even Dijkstra is not streamable, which is an easy graph traversal algorithm compared to Leiden.
Obviously, SATA SSD we've been using has hit it's limit.
But if I understand it correctly, IO souldn't be a problem (for now) if using M2 SSDs.
But if I understand it correctly, IO souldn't be a problem (for now) if using M2 SSDs.
September 6, 2024 at 8:16 PM
Obviously, SATA SSD we've been using has hit it's limit.
But if I understand it correctly, IO souldn't be a problem (for now) if using M2 SSDs.
But if I understand it correctly, IO souldn't be a problem (for now) if using M2 SSDs.
they can't handle the load anymore 😢
Well, this is probably it.
But there's hope.
All the code is here:
github.com/witchmonster...
github.com/witchmonster...
github.com/witchmonster...
Feel free to reach out to @witch.monster if you need any advice on setting it up.
But there's hope.
All the code is here:
github.com/witchmonster...
github.com/witchmonster...
github.com/witchmonster...
Feel free to reach out to @witch.monster if you need any advice on setting it up.
sorry, after Brazil joined, feeds probably won't go up again. all my indexers are down.
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
September 6, 2024 at 2:49 PM
they can't handle the load anymore 😢
@suboptimal.technology and @redsolver.dev might be of more help here
as @suboptimal.technology is now figuring out how to make the big indexer work (the one for dataset generation), while @redsolver.dev just successfully upgraded infrastructure for his feeds to work with the new firehose throughput
as @suboptimal.technology is now figuring out how to make the big indexer work (the one for dataset generation), while @redsolver.dev just successfully upgraded infrastructure for his feeds to work with the new firehose throughput
September 6, 2024 at 2:25 AM
@suboptimal.technology and @redsolver.dev might be of more help here
as @suboptimal.technology is now figuring out how to make the big indexer work (the one for dataset generation), while @redsolver.dev just successfully upgraded infrastructure for his feeds to work with the new firehose throughput
as @suboptimal.technology is now figuring out how to make the big indexer work (the one for dataset generation), while @redsolver.dev just successfully upgraded infrastructure for his feeds to work with the new firehose throughput
it's kind of both. dataset needed for generating clusters just grew 10x
firehose throughput, thus memory+cpu demand for indexers grew 4-5x
this is my current setup (that is no longer handling it):
firehose throughput, thus memory+cpu demand for indexers grew 4-5x
this is my current setup (that is no longer handling it):
September 6, 2024 at 2:22 AM
it's kind of both. dataset needed for generating clusters just grew 10x
firehose throughput, thus memory+cpu demand for indexers grew 4-5x
this is my current setup (that is no longer handling it):
firehose throughput, thus memory+cpu demand for indexers grew 4-5x
this is my current setup (that is no longer handling it):
I think exploring possibilities to continue collaboration with people like @redsolver.dev, who already have some funding and infrastructure to rely on is the most sustainable solution for this project
September 6, 2024 at 2:18 AM
I think exploring possibilities to continue collaboration with people like @redsolver.dev, who already have some funding and infrastructure to rely on is the most sustainable solution for this project
I appreciate it. I'm willing to donate my work (and a bit of money) into this project.
but since I'm not a startup, taking donations is whole another story which is a little bit too much
but since I'm not a startup, taking donations is whole another story which is a little bit too much
September 6, 2024 at 2:17 AM
I appreciate it. I'm willing to donate my work (and a bit of money) into this project.
but since I'm not a startup, taking donations is whole another story which is a little bit too much
but since I'm not a startup, taking donations is whole another story which is a little bit too much
sorry, after Brazil joined, feeds probably won't go up again. all my indexers are down.
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
September 5, 2024 at 11:04 PM
sorry, after Brazil joined, feeds probably won't go up again. all my indexers are down.
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
I may offer some limited by PDS solution in the future.
also happy to help and advice with any solution based on SkyGraph open source code if anyone with adequate recources/funding wants to pick up the project
Feeds were running on 8 v. core 16GBram+160GB storage OVH box
September 4, 2024 at 11:40 PM
Feeds were running on 8 v. core 16GBram+160GB storage OVH box
MSI Infinite X (2018 model) gaming PC with Ubuntu installed.
Upgraded to 64 GB RAM and added 4TB Samsung EVO SSD
www.msi.com/Desktop/infi...
Upgraded to 64 GB RAM and added 4TB Samsung EVO SSD
www.msi.com/Desktop/infi...
September 4, 2024 at 11:39 PM
MSI Infinite X (2018 model) gaming PC with Ubuntu installed.
Upgraded to 64 GB RAM and added 4TB Samsung EVO SSD
www.msi.com/Desktop/infi...
Upgraded to 64 GB RAM and added 4TB Samsung EVO SSD
www.msi.com/Desktop/infi...