Skip to content

Piero Bosio Social Web Site Personale Logo Fediverso

Social Forum federato con il resto del mondo. Non contano le istanze, contano le persone

This morning, a dev I work with flagged a server that was struggling.

Uncategorized
4 3 13
  • This morning, a dev I work with flagged a server that was struggling. I logged in and, unfortunately, a bunch of "Scrapers" were hammering it, causing an overload. This dev is very sharp and understood the situation. He started extending the caching margins. I prepared a list of countries of interest and, using pf, blocked the rest of the world.
    The load plummeted, and the client doesn't care about their products being visible outside of specific markets.

    Shortly after, a similar situation on another server I manage (subcontracted, to be precise). I didn't know this dev and saw there was no caching in place, so I spoke to him and asked him to implement it. His response, sadly predictable, was that another one of his clients just moved to $CLOUD_PROVIDER and no longer has these problems, simply paying more when these "attacks" become more intense. I suggested he try enabling caching and thinking about their markets of interest. He's a positive person, so he agreed to give it a shot. A short while later, just by adding Varnish and some good VCL, the load dropped from 100% to 5%. Without any blocking.

    He called me a little while ago, incredulous and happy.

    It's always a pleasure to work with people who are willing to experiment, explore, and listen. With people who don't just follow the herd or ad banners, but who think for themselves. I've earned myself a walk outside the office now.

  • This morning, a dev I work with flagged a server that was struggling. I logged in and, unfortunately, a bunch of "Scrapers" were hammering it, causing an overload. This dev is very sharp and understood the situation. He started extending the caching margins. I prepared a list of countries of interest and, using pf, blocked the rest of the world.
    The load plummeted, and the client doesn't care about their products being visible outside of specific markets.

    Shortly after, a similar situation on another server I manage (subcontracted, to be precise). I didn't know this dev and saw there was no caching in place, so I spoke to him and asked him to implement it. His response, sadly predictable, was that another one of his clients just moved to $CLOUD_PROVIDER and no longer has these problems, simply paying more when these "attacks" become more intense. I suggested he try enabling caching and thinking about their markets of interest. He's a positive person, so he agreed to give it a shot. A short while later, just by adding Varnish and some good VCL, the load dropped from 100% to 5%. Without any blocking.

    He called me a little while ago, incredulous and happy.

    It's always a pleasure to work with people who are willing to experiment, explore, and listen. With people who don't just follow the herd or ad banners, but who think for themselves. I've earned myself a walk outside the office now.

    @stefano About paying more. We used to have that classic approach of "just add some resources for now".
    Until a magic point where boss asked "why the hell are we paying twice as much with same amount of users?"
    And then was painful and frustrating process of optimizing and downscaling working system.
    Most cliche IT story ever. :)

  • @stefano About paying more. We used to have that classic approach of "just add some resources for now".
    Until a magic point where boss asked "why the hell are we paying twice as much with same amount of users?"
    And then was painful and frustrating process of optimizing and downscaling working system.
    Most cliche IT story ever. :)

    This post is deleted!
  • This morning, a dev I work with flagged a server that was struggling. I logged in and, unfortunately, a bunch of "Scrapers" were hammering it, causing an overload. This dev is very sharp and understood the situation. He started extending the caching margins. I prepared a list of countries of interest and, using pf, blocked the rest of the world.
    The load plummeted, and the client doesn't care about their products being visible outside of specific markets.

    Shortly after, a similar situation on another server I manage (subcontracted, to be precise). I didn't know this dev and saw there was no caching in place, so I spoke to him and asked him to implement it. His response, sadly predictable, was that another one of his clients just moved to $CLOUD_PROVIDER and no longer has these problems, simply paying more when these "attacks" become more intense. I suggested he try enabling caching and thinking about their markets of interest. He's a positive person, so he agreed to give it a shot. A short while later, just by adding Varnish and some good VCL, the load dropped from 100% to 5%. Without any blocking.

    He called me a little while ago, incredulous and happy.

    It's always a pleasure to work with people who are willing to experiment, explore, and listen. With people who don't just follow the herd or ad banners, but who think for themselves. I've earned myself a walk outside the office now.

    This post is deleted!

Gli ultimi otto messaggi ricevuti dalla Federazione
Post suggeriti
  • 0 Votes
    1 Posts
    4 Views
    New blog post: Managing FreeBSD Jails with Ansible.I wrote jailexec - an Ansible connection plugin that lets you manage FreeBSD jails without running SSH inside each one. It connects to the jail host via SSH and uses jexec to run commands, just like you would manually. Features: • Single Python file, easy install • Supports doas and sudo • Secure two-stage file transfers • Works with any jail managerBlog: https://blog.hofstede.it/managing-freebsd-jails-with-ansible-the-jailexec-connection-plugin/Code: https://github.com/chofstede/ansible_jailexec#FreeBSD #Ansible #DevOps #SysAdmin #Jails #Automation
  • 0 Votes
    10 Posts
    20 Views
    @_elena thank you. I did it: https://fedimeteo.com/fedi/admin/p/1765180904.566035
  • 0 Votes
    1 Posts
    12 Views
    Installing #openbsd is easy, but what does it take to keep your system in trim?Here is a piece I wrote, "You Have Installed OpenBSD. Now For The Daily Tasks." https://nxdomain.no/~peter/openbsd_installed_now_for_the_daily_tasks.html to provide some pointers (also at https://bsdly.blogspot.com/2024/09/you-have-installed-openbsd-now-for.html if tracking is not a thing you worry about) #maintenance #sysadmin #dailytasks #dailydriver
  • 0 Votes
    1 Posts
    13 Views
    The client has a terrible, unreliable FTTC connection. So, this morning, I've been testing several devices and 4G carriers to find a reliable alternative when the FTTC is full/down.The good, old LTE12 Chateau is the best for this task, giving a stable and reliable 220/50 Mbit/sec thanks to carrier aggregation.The newer but smaller hAP ax lite LTE6 is still giving a good result, around 100/50 - expected, as it's "only" a LTE6. This will probably come to my office, while I'm waiting for the Chateau 5G (LTE20) to arrive - probably not before middle of November.Now, I need to create proper queues and rules to manage the two connections - at the moment, I've implemented only the failover and some simple queues on the FTTC.Lunch time.#Mikrotik #IT #SysAdmin #MorningFun