Skip to content

Piero Bosio Social Web Site Personale Logo Fediverso

Social Forum federato con il resto del mondo. Non contano le istanze, contano le persone

This morning, a dev I work with flagged a server that was struggling.

Uncategorized
4 3 13
  • This morning, a dev I work with flagged a server that was struggling. I logged in and, unfortunately, a bunch of "Scrapers" were hammering it, causing an overload. This dev is very sharp and understood the situation. He started extending the caching margins. I prepared a list of countries of interest and, using pf, blocked the rest of the world.
    The load plummeted, and the client doesn't care about their products being visible outside of specific markets.

    Shortly after, a similar situation on another server I manage (subcontracted, to be precise). I didn't know this dev and saw there was no caching in place, so I spoke to him and asked him to implement it. His response, sadly predictable, was that another one of his clients just moved to $CLOUD_PROVIDER and no longer has these problems, simply paying more when these "attacks" become more intense. I suggested he try enabling caching and thinking about their markets of interest. He's a positive person, so he agreed to give it a shot. A short while later, just by adding Varnish and some good VCL, the load dropped from 100% to 5%. Without any blocking.

    He called me a little while ago, incredulous and happy.

    It's always a pleasure to work with people who are willing to experiment, explore, and listen. With people who don't just follow the herd or ad banners, but who think for themselves. I've earned myself a walk outside the office now.

  • This morning, a dev I work with flagged a server that was struggling. I logged in and, unfortunately, a bunch of "Scrapers" were hammering it, causing an overload. This dev is very sharp and understood the situation. He started extending the caching margins. I prepared a list of countries of interest and, using pf, blocked the rest of the world.
    The load plummeted, and the client doesn't care about their products being visible outside of specific markets.

    Shortly after, a similar situation on another server I manage (subcontracted, to be precise). I didn't know this dev and saw there was no caching in place, so I spoke to him and asked him to implement it. His response, sadly predictable, was that another one of his clients just moved to $CLOUD_PROVIDER and no longer has these problems, simply paying more when these "attacks" become more intense. I suggested he try enabling caching and thinking about their markets of interest. He's a positive person, so he agreed to give it a shot. A short while later, just by adding Varnish and some good VCL, the load dropped from 100% to 5%. Without any blocking.

    He called me a little while ago, incredulous and happy.

    It's always a pleasure to work with people who are willing to experiment, explore, and listen. With people who don't just follow the herd or ad banners, but who think for themselves. I've earned myself a walk outside the office now.

    @stefano About paying more. We used to have that classic approach of "just add some resources for now".
    Until a magic point where boss asked "why the hell are we paying twice as much with same amount of users?"
    And then was painful and frustrating process of optimizing and downscaling working system.
    Most cliche IT story ever. :)

  • @stefano About paying more. We used to have that classic approach of "just add some resources for now".
    Until a magic point where boss asked "why the hell are we paying twice as much with same amount of users?"
    And then was painful and frustrating process of optimizing and downscaling working system.
    Most cliche IT story ever. :)

    This post is deleted!
  • This morning, a dev I work with flagged a server that was struggling. I logged in and, unfortunately, a bunch of "Scrapers" were hammering it, causing an overload. This dev is very sharp and understood the situation. He started extending the caching margins. I prepared a list of countries of interest and, using pf, blocked the rest of the world.
    The load plummeted, and the client doesn't care about their products being visible outside of specific markets.

    Shortly after, a similar situation on another server I manage (subcontracted, to be precise). I didn't know this dev and saw there was no caching in place, so I spoke to him and asked him to implement it. His response, sadly predictable, was that another one of his clients just moved to $CLOUD_PROVIDER and no longer has these problems, simply paying more when these "attacks" become more intense. I suggested he try enabling caching and thinking about their markets of interest. He's a positive person, so he agreed to give it a shot. A short while later, just by adding Varnish and some good VCL, the load dropped from 100% to 5%. Without any blocking.

    He called me a little while ago, incredulous and happy.

    It's always a pleasure to work with people who are willing to experiment, explore, and listen. With people who don't just follow the herd or ad banners, but who think for themselves. I've earned myself a walk outside the office now.

    This post is deleted!

Gli ultimi otto messaggi ricevuti dalla Federazione
Post suggeriti
  • 0 Votes
    1 Posts
    3 Views
    @mwl@io.mwl.io’s post made me revisit RCS in a very small role: a safety net for individual files.Paired with nvi, a tiny wrapper lets me snapshot configs before risky edits. Simple, local, no magic.Example wrapper I’m using:#!/bin/sh## safeedit — RCS-backed safe editing with nvi#set -eif [ $# -ne 1 ]; then echo "usage: safeedit <file>" >&2 exit 1fiFILE="$1"if [ ! -f "$FILE" ]; then echo "safeedit: file not found: $FILE" >&2 exit 1fiDIR=$(dirname "$FILE")BASE=$(basename "$FILE")RCS_DIR="$DIR/RCS"RCS_FILE="$RCS_DIR/$BASE,v"mkdir -p "$RCS_DIR"chmod 700 "$RCS_DIR"if [ ! -f "$RCS_FILE" ]; then ci -l "$FILE"else ci -u "$FILE" || true co -l "$FILE"fiexec nvi "$FILE"nvi protects the session; RCS protects the decision.Original post by @mwl@snac.bsd.cafe: https://io.mwl.io/@mwl/115814245521209100#nvi #RCS #Unix #SysAdmin #ConfigManagement
  • 0 Votes
    4 Posts
    2 Views
    @catavz true. That's why I hope more and more people will be interested and try the BSDs. They are great to learn, and a great way to make people more aware of what and how they're running.
  • okay.

    Uncategorized n4sa2e openzfsmastery bhyve sysadmin
    1
    0 Votes
    1 Posts
    12 Views
    okay. #n4sa2e book production is complete. Time to get on #openzfsmastery. Which means seriously getting to grips with #bhyve. Did some bhyve experimenting a couple weeks ago. Got FreeBSD installed just fine. Debian with ZFS, not so much.So this week it's go back, one step at a time. Install base debian with grub, does it work? Then UEFI, then ZFS secondary disk, then root on ZFS.This morning's install ends with a console saying:grub>#sysadmin The Debian installer wrote grub to disk, but... didn't configure it? Huh.Time for some classic #sysadmin headdesking.
  • Computers were a mistake

    Uncategorized sysadmin kickstarter n4sa2e
    1
    0 Votes
    1 Posts
    13 Views
    Computers were a mistake.So were networks.When they overlap, you're in trouble. A #sysadmin must know some networking. How much? This much. https://mwl.io/ks #kickstarter #n4sa2e