• Hail Guest!
    We're looking for Community Content Contribuitors to Stratics. If you would like to write articles, fan fiction, do guild or shard event recaps, it's simple. Find out how in this thread: Community Contributions
  • Greetings Guest, Having Login Issues? Check this thread!
  • Hail Guest!,
    Please take a moment to read this post reminding you all of the importance of Account Security.
  • Hail Guest!
    Please read the new announcement concerning the upcoming addition to Stratics. You can find the announcement Here!

Stratics getting DDOS'd?

Poo

The Grandest of the PooBah’s
Alumni
Stratics Veteran
Stratics Legend
Campaign Benefactor
there are 8 people logged into stratics and almost 500 visitors?
and the website is boggy as all heck!
 

Pawain

I Hate Skilling
Stratics Veteran
Stratics Legend
UNLEASHED
The site has been going fast for me. But that is funny, 10 members, 428 guests right now.
 

Keven2002

Babbling Loonie
Stratics Veteran
Stratics Legend
UNLEASHED
...annnnd +30 guests within the last 60 seconds


1755428117409.png

I think the counter might be giving RNG guest #s lol
 

old gypsy

Grand Poobah
Professional
Stratics Veteran
Stratics Legend
Campaign Patron
Perhaps most of the guests may be actual members who may read the site without logging in?
 

Luc of Legends

Lore Keeper
Stratics Veteran
Stratics Legend
UNLEASHED
Web Crawler was an old search engine. Techies need to not steal that name it was before the web was crowded.
Hey, pancakes for brains! I have a BACHELORS DEGREE in INFORMATION TECHOLOGY!

Which trumps your PhD in TROLL!


From Google:

A web crawler (also known as a web spider or bot) is a software program designed to systematically browse and index the World Wide Web. It operates by starting with a "seed" URL (a starting point) and then following hyperlinks to other pages, gathering information along the way. This process helps search engines build indices of web content, enabling users to find relevant web pages efficiently when they enter search queries.
How web crawlers work
  1. Starts with a seed URL: The crawler begins its journey from a given starting page.
  2. Retrieves page content: It downloads the HTML content of that page.
  3. Extracts information: It parses the HTML to identify and extract data points, including links to other web pages.
  4. Adds new URLs to a queue: These newly discovered URLs are added to a list for future crawling.
  5. Repeats the process: The crawler continues to visit new URLs from the queue, recursively following links and collecting data.
Purposes of web crawlers
  • Search engine indexing: This is the most common use, allowing search engines to provide relevant results.
  • Data collection: Businesses use crawlers to gather information for various purposes like price comparison, market research, or lead generation.
  • Website analysis and testing: Crawlers can help monitor website changes, identify broken links, and analyze website structure.
  • Content aggregation: Crawlers can be used to gather and display content from multiple sources, like news aggregators or RSS feeds.
Creating a web crawler (using Python)
Python is a popular choice for building web crawlers due to its ease of use and readily available libraries. You can use a combination of libraries like:
  • requests: For making HTTP requests to download web pages.
  • Beautiful Soup: For parsing HTML and extracting data.
  • Scrapy: A comprehensive framework for large-scale crawling and scraping, offering built-in features for handling duplicates, managing queues, and exporting data.
Ethical considerations
When building and using web crawlers, it's crucial to adhere to ethical and legal guidelines:
  • Respect robots.txt: This file on a website dictates which parts of the site can be crawled. Always check and comply with its rules.
  • Rate limiting: Implement delays between requests to avoid overwhelming the website's server.
  • User-agent transparency: Identify your crawler using a user-agent header.
  • Avoid scraping sensitive data: Do not access private information or bypass security measures.
By understanding how web crawlers work and following ethical practices, you can effectively leverage this technology for various purposes while ensuring responsible web usage.
NOW STICK THAT IN YOUR CODE AND RUN IT WHY DON'T YA!
 

Veldrane

Sage
Stratics Veteran
Stratics Legend
UNLEASHED
Hey, pancakes for brains! I have a BACHELORS DEGREE in INFORMATION TECHOLOGY!

Which trumps your PhD in TROLL!


NOW STICK THAT IN YOUR CODE AND RUN IT WHY DON'T YA!

Dude, you need to chill. First of all most of what you’re saying just dumb. Nobody is going to waste thier time scrapping Statics or hitting it with an honest to god targeted DDOS attack. So if it is an attack it’s most likely a bot that’s gotten stuck and is stroking out. More likely is there is a hardware related issue or other traffic kerfuffle on the network someplace.

Your BS in IT should have been enough to tell you that unless it’s just BS.
 

Cymidei

UO Pacific News Reporter
Alumni
Supporter
Stratics Veteran
Campaign Supporter
Nobody is going to DDos Stratics! Lol Think about it, why would they when they could be making money or mining bitcoin or whatever.
 

Luc of Legends

Lore Keeper
Stratics Veteran
Stratics Legend
UNLEASHED
Dude, you need to chill. First of all most of what you’re saying just dumb. Nobody is going to waste their time scrapping Stratics or hitting it with an honest to god targeted DDOS attack. So if it is an attack it’s most likely a bot that’s gotten stuck and is stroking out. More likely is there is a hardware related issue or other traffic kerfuffle on the network someplace.

Your BS in IT should have been enough to tell you that unless it’s just BS.
Veldrane, READING IS FUNDEMENTAL! The OP said DDOS. NOT ME! Pudding-for-brains I said Bots and Crawler traffic. PERIOD.
This site has a subscription option aka Stratics Pro. Bad actors love trying to get financial or personal data.
They don't care, what website. They don't care if its Big Poo Pit Septic Systems, Stratics, or Granny's homemade Jams & Jellies.
Its data. Data = MONEY on the dark web.
BTW, I am a FEMALE. Unless you're one of those people that can't tell the difference between Males and Females.
Next time BEFORE you ASSUME ask me what are my PRONOUNS!

Don't Have an argument with an idiot because people watching may not know the difference!
 
Top