Skip to content

Piero Bosio Social Web Site Personale Logo Fediverso

Social Forum federato con il resto del mondo. Non contano le istanze, contano le persone

This morning, a dev I work with flagged a server that was struggling.

Uncategorized
4 3 13
  • This morning, a dev I work with flagged a server that was struggling. I logged in and, unfortunately, a bunch of "Scrapers" were hammering it, causing an overload. This dev is very sharp and understood the situation. He started extending the caching margins. I prepared a list of countries of interest and, using pf, blocked the rest of the world.
    The load plummeted, and the client doesn't care about their products being visible outside of specific markets.

    Shortly after, a similar situation on another server I manage (subcontracted, to be precise). I didn't know this dev and saw there was no caching in place, so I spoke to him and asked him to implement it. His response, sadly predictable, was that another one of his clients just moved to $CLOUD_PROVIDER and no longer has these problems, simply paying more when these "attacks" become more intense. I suggested he try enabling caching and thinking about their markets of interest. He's a positive person, so he agreed to give it a shot. A short while later, just by adding Varnish and some good VCL, the load dropped from 100% to 5%. Without any blocking.

    He called me a little while ago, incredulous and happy.

    It's always a pleasure to work with people who are willing to experiment, explore, and listen. With people who don't just follow the herd or ad banners, but who think for themselves. I've earned myself a walk outside the office now.

  • This morning, a dev I work with flagged a server that was struggling. I logged in and, unfortunately, a bunch of "Scrapers" were hammering it, causing an overload. This dev is very sharp and understood the situation. He started extending the caching margins. I prepared a list of countries of interest and, using pf, blocked the rest of the world.
    The load plummeted, and the client doesn't care about their products being visible outside of specific markets.

    Shortly after, a similar situation on another server I manage (subcontracted, to be precise). I didn't know this dev and saw there was no caching in place, so I spoke to him and asked him to implement it. His response, sadly predictable, was that another one of his clients just moved to $CLOUD_PROVIDER and no longer has these problems, simply paying more when these "attacks" become more intense. I suggested he try enabling caching and thinking about their markets of interest. He's a positive person, so he agreed to give it a shot. A short while later, just by adding Varnish and some good VCL, the load dropped from 100% to 5%. Without any blocking.

    He called me a little while ago, incredulous and happy.

    It's always a pleasure to work with people who are willing to experiment, explore, and listen. With people who don't just follow the herd or ad banners, but who think for themselves. I've earned myself a walk outside the office now.

    @stefano About paying more. We used to have that classic approach of "just add some resources for now".
    Until a magic point where boss asked "why the hell are we paying twice as much with same amount of users?"
    And then was painful and frustrating process of optimizing and downscaling working system.
    Most cliche IT story ever. :)

  • @stefano About paying more. We used to have that classic approach of "just add some resources for now".
    Until a magic point where boss asked "why the hell are we paying twice as much with same amount of users?"
    And then was painful and frustrating process of optimizing and downscaling working system.
    Most cliche IT story ever. :)

    This post is deleted!
  • This morning, a dev I work with flagged a server that was struggling. I logged in and, unfortunately, a bunch of "Scrapers" were hammering it, causing an overload. This dev is very sharp and understood the situation. He started extending the caching margins. I prepared a list of countries of interest and, using pf, blocked the rest of the world.
    The load plummeted, and the client doesn't care about their products being visible outside of specific markets.

    Shortly after, a similar situation on another server I manage (subcontracted, to be precise). I didn't know this dev and saw there was no caching in place, so I spoke to him and asked him to implement it. His response, sadly predictable, was that another one of his clients just moved to $CLOUD_PROVIDER and no longer has these problems, simply paying more when these "attacks" become more intense. I suggested he try enabling caching and thinking about their markets of interest. He's a positive person, so he agreed to give it a shot. A short while later, just by adding Varnish and some good VCL, the load dropped from 100% to 5%. Without any blocking.

    He called me a little while ago, incredulous and happy.

    It's always a pleasure to work with people who are willing to experiment, explore, and listen. With people who don't just follow the herd or ad banners, but who think for themselves. I've earned myself a walk outside the office now.

    This post is deleted!

Gli ultimi otto messaggi ricevuti dalla Federazione
Post suggeriti
  • 0 Votes
    14 Posts
    13 Views
    @nuintari It was 2006, I think (or 2007 at the latest), and I went with a colleague to a company - the same one that, incidentally, gave us some decommissioned Digital AlphaStations. They showed me a machine (not connected to the network, obviously) that they were still using for payroll. I couldn't quite tell what it was exactly, but it was some kind of Unix system and it had been rebooted for the last time... in 1986. I believe it’s the longest uptime I’ve ever seen.
  • 0 Votes
    1 Posts
    3 Views
    Today, I lived through one of those (not only IT) horror stories. It's not over yet, but it’s definitely going to end up in a blog post. It's one of those situations where the 'horror' has already happened or is still going to happen, but this time, I'm the one handling the rescue. I couldn't prevent the disaster itself, but I managed to save the data. What-a-day!#IT #SysAdmin #HorrorStories #SaveTheData #OwnYourData
  • 0 Votes
    23 Posts
    93 Views
    @stefano @ricardo the article mentioned the FreeBSD subreddit and The FreeBSD Forums. Yorick Peterse shared his post in the sub, where it was very well-received. Pictured: insights that are not visible to the public (I very rarely share such things, doing so seems harmless on this occasion). No mention of Discord, Twitter, or X. Also pictured: the wiki for FreeBSD Discord very recently cautioned that the FreeBSD Community Code of Conduct can not be enforced. I do not imagine that this caution relates to any recent misconduct there …<https://www.freebsd.org/internal/code-of-conduct/><https://wiki.freebsd.org/Discord/DiscordServer><https://yorickpeterse.com/>#FreeBSD #Reddit #forums #Discord #community #conduct #misconduct
  • 0 Votes
    1 Posts
    16 Views
    🧠 Nixers Newsletter #311 is out!Boot processes, reproducible builds, user-mode Linux, FreeBSD sandboxes, and even /dev/null as a database 😄Plus:• Fedora KDE pkg mgmt• Debian vs systemd• raconn — a smart tool for parallel SSH connections to multiple hostnames/IPs in one ProxyCommand. (https://blog.izissise.net/posts/raconn/)• UBIOS (China’s UEFI-alt)Read it 👉 https://newsletter.nixers.net/entries.php#311“There are no life hacks, only trade-offs.” — James Clear#Unix #Linux #FreeBSD #FOSS #SysAdmin #ReproducibleBuilds #SSH #Nixers