Skip Navigation

User banner
Salamander
Salamander @ Sal @mander.xyz
Posts
461
Comments
1,001
Joined
4 yr. ago

  • No problem! Happy to contribute

  • No, I always yesice

  • How dare you

  • Three kids in a trenchcoat

  • Thanks!

    I don't see those specific IPs, nor 16514. But now I see what scrapers tend to look like in the logs :)

    I am now pretty sure that the cause was scraper-like activity coming from the Mlmym front-end that I am serving over an onion site. I am not sure if it randomly started mis-behaving or if a tor scraper was using it.

    After blocking this, federation was restored, performance increased, and CPU use came down:

  • I just realized that it is not a 'scraper', the requests came from the server that I am using to provide an interface to the site as an Onion site. The amount of requests was suspiciously high so maybe a bot is scraping through Tor. I will leave it off for a few days and see if I can turn it back on later.

  • Thanks! It seems like the lag may have been due to a scraper

  • I did not update or change anything in the past few days.

    But, now that you mentioned an AI scrapper I looked into the logs and noticed some heavy requests to the API from a specific IP.

    Requests look consistent to scraping - just consistently and continuously issuing GET requests to different API endpoints.

     
        
    XX.XX.XX.XX - - [14/Oct/2025:21:28:54 +0000] "GET /api/v3/community/list?limit=20&sort=TopAll HTTP/2.0" 403 107 "-" "Mlmym"
    
     
    
      

    I have started denying their requests and it is the first thing that seems to have actually helped!

    I don't want to speak too early but I think you may have identified the cause. Thanks!

  • So far, I have been able to 'control' the CPU use by setting limits to the process that pulls stuff from the database (pool size, CPU, memory).

    This does release some of the CPU for other tasks, but I think that that what creates the lag might actually be the clogged database queries. So, constraining those resources might not solve the lag problem.

  • Hmm, thanks!

    I just made another change. I am not sure why the database suddenly started taking up so many resources, so I have reduced the amount of resources available to it. It did reduce CPU use to 80% as opposed to 100%, but it is still somewhat laggy for me.

  • I can see that since October 13 the CPU use spiked to 100%...

    I just reset the server to check if that would fix it quickly. It don't think it did.

    I can see the processes that are taking up a lot of CPU (parallell database queries it seems), but I still don't understand what is causing these and why they have spiked since Oct 13. I will need to investigate.

  • Hopefully the English language is developed and Rick Astley gets to make his song before anyone figures it out!

  • I'd rather pay for preventing the front passenger from reclining into me.

  • I would take a portable CD player, place a CD with Rick Astley's Never Gonna Give You Up on it playing backwards, hook up solar panels, remove the ability to shut it on/off, and set it up a circuit that will:

    • As the device solar charges, keep it off until some voltage threshold is exceeded
    • Once the voltage is high enough, start a random timer (8 - 100 hours), so that it is not immediately obvious that the sun activated the device
    • When the timer ends, turn the music on on repeat mode
    • Sometimes turn the music off at random, and then turn it on again at random after a long delay, so that in some cases you can have turn 'ON' events without the device being exposed to the sun
    • When the voltage drops below a low threshold, turn the device off until it is charged again
  • I speak spanish natively and at during uni I would hang out with a group of Brazillian friends. I would speak a mixture of portuguese and spanish with them.

    The mom of one of these friends made a Brazilian dish for us (Feijoada) and asked me how it was as it was the first time I tried it. I answered that the dish as 'exquisito', which in Spanish means delicious (similar 'exquisite'). She seemed somewhat disappointed and upset by my response so I probed a little and found out that 'esquisito' in Portuguese actually means 'weird'. She thought I was calling her dish weird tasting. I found quickly enough to clarify, but I did feel bad about making her fell that way... She was very excited about sharing her cooking and she thought I called it weird.

  • No worries! If you need me to test something with it I can this week, just let me know

  • Cool to see you here too! 😄

  • I am currently near Cologne in Germany. I placed one of these LycaMobile SIM cards from NL and it activated automatically. It does recognize that it is connected to the German network and roaming, and still activates data and assigns a phone number.

    So, it seems to work fine

  • It's spider season! That's very normal in September/October. At least in the Netherlands but I imagine it's similar in the UK.

    I didn't know about Foxes. I very rarely see them.

  • AI @lemmy.ml

    Delegation to artificial intelligence can increase dishonest behaviour

    Peertube @lemmy.ml

    Brainstorm: Improving Lemmy <-> PeerTube Federation

    Mander @mander.xyz

    Mander has been updated to v0.19.13

    Privacy @lemmy.ml

    The Pager

    Photonics @mander.xyz

    Tantalo-gallate glass as robust nonlinear medium for mid-infrared photonics

    Physics @mander.xyz

    Bright yet dark: how strong coupling quenches exciton-polariton radiation

    Photonics @mander.xyz

    Electrostatic MEMS Phase Shifter for SiN Photonic Integrated Circuits

    Myrmecology @mander.xyz

    Better Safe Than Sorry: Leg Amputations as a Prophylactic Wound Care Behaviour in Carpenter Ants

    Psychedelics @lemmy.ca

    Freedom of Recreation: A Critique of the Prohibition, Decriminalization, and Legal Regulation of Psychedelics for Recreational Use

    Reptiles and Amphibians @mander.xyz

    The Dry-Climate Hypothesis: Identifying the Environmental Drivers of Terrestrial Viviparous Salamanders

    Abiogenesis @mander.xyz

    Potentially prebiotic isocyanide activation chemistry drives RNA assembly

    Spectroscopy @mander.xyz

    Lattice-induced spin dynamics in Dirac magnet CoTiO3

    Abiogenesis @mander.xyz

    Exploring the space of self-reproducing ribozymes using generative models

    Photosynthesis @mander.xyz

    Photophysics of plasmonically enhanced self-assembled artificial light-harvesting nanoantennas

    Molecular Motors @mander.xyz

    A Molecular Rotor Driven by an Electric Field on Graphene

    Ecology @mander.xyz

    Flexible hybrid edge computing IoT architecture for low-cost bird songs detection system

    Lichen @mander.xyz

    Peltigera sp.

    Photonics @mander.xyz

    Ultrabroadband on-chip photonics for full-spectrum wireless communications

    Abiogenesis @mander.xyz

    Thioester-mediated RNA aminoacylation and peptidyl-RNA synthesis in water

    Bees and Beekeeping @mander.xyz

    Scientists found the missing nutrients bees need — Colonies grew 15-fold