Category Archives: DansGuardian

Something smells funny at urlblacklist.com

Competition is great, it drives innovation and gives companies the incentive to improve and the drive needed to continue to improve services and products. And in the spirit of competition sometimes a little dirt gets slung. But it isn’t only serving our personal interests to outline the failures of one of our competitors today. In this case, I believe that it is in fact doing the public a service. And by this I mean spreading awareness, to warn unsuspecting customers of what they are spending their money on, and of course, to convince you. with a little sound reasoning, to purchase our services instead of the competition.

There aren’t many suppliers of domain blacklist data for web filtering platforms and applications, this is one of the primary motivating reasons why we created Squidblacklist.org in 2012. We knew it could be done better. There are however a small handful of other providers remaining. One of these websites is urlblacklist.com, and it is them whom we have chosen to single out for scrutiny in this blog post.

The website urlblacklist.com was down for nearly an entire month in October 2016. Then, a second outage occured that lasted nearly 2 months, beginning on or around Nov 10, lasting through until Dec 30, 2016. Further scrutiny reveals that in Nov of 2016, the owner of urlblacklist.com irresponsibly allowed his domain name to expire, which resulted in another 2 month long outage, in which another company took the opportunity to purchase the domain name, which is now registered under an entity named “Dr Guardian” who one can only assume has taken ownership and reopened the website, and is actively processing payments by unsuspecting customers.

They also do not make any mention of ownership changing hands anywhere on their website, a courtesy any respectable business would extend to its existing clients and the general public. Instead of even acknowledging the domain name ownership change. they choose to deceptively place blame for the outage on a billing issue with their registrar.

And I doubt if anybody knows who is really even operating the website. The owner has never responded to emails, doesn’t seem too care if his website goes down until months later, and I suggest that you should seriously consider switching to Squidblacklist.org if you are a current urlblacklist.com subscriber.

A brief visit to urlblacklist.com shows that the owner would like you to believe the second extended outage of 2016 was brief, a deception which is evident in a recent “news” message claiming that “over Christmas vacation” there was an outage, I guess Christmas vacation begins around Nov 10 and ends December 30th for the owner.

One can safely assume by looking at the ancient and truly aweful web design of urlblacklist.com and then research its track record of unreliability, and make some general conclusions about its owner and or operators which are to say, generally not favorable at all. And this lack of integrity can also be found in the quality of their blacklists, or lack thereof, which is of course, what really matters.

In summary, Urlblacklist.com is a horrible service provider. One whos website was recently down for over 3 months in the 2016 calendar year. As a provider of services to paying clients, this is simply a disgrace. We have been monitoring urlblacklist.com, watched multiple outages, and we know that their domain name changed hands recently, something they did not announce on their website, so we will do it here.

Urlblacklist.com is an aging website. I would encourage you to use their lists, and monitor the daily changes, you will know first hand that nearly 60% of the domains in their blacklists do not even resolve, a good indicator that there is very poor technology behind the update processes going on behind the scenes. It becomes clear rather quickly that they are pushing old, recycled domain data by systematically removing a set number of domains and re-adding them back using some crude scripts or something, rotating this data in and out in a way which gives the customer the illusion that updates are taking place.

With manual additions and removals being performed occasionally presumably by human hands. Beyond this however, there is obviously zero innovation taking place at urlblacklist.com. Which is evidently ran by an incompetent individual who is doing the world a disservice by continuing to accept payments for what is, in our opinion, hardly passable even as a purely free service.

Shalla and any other websites referring people to this website are also guilty of doing the general public a disservice by linking to urlblacklist.com because clearly anybody who has actually observed or used the lists from these people should come to the same conclusions that we have, and that is urlblacklist.com is an unreliable provider of services that needs to go away.

Also make note that shady clones of urlblacklist.com are also in existence, these domains are registered by totally different owners.
http://schwela.com is one of them.


If you like what we are doing here and want to support our efforts, please consider subscribing to download all of our blacklists.

Flat rate subscription. For full access to all of our works, select a membership option & subscribe today.



Select Payment Option




New Blacklist: A List of Terrorist & Extremist Domains.

We have been working to compile the initial release of a new blacklist, which we have now released in the members area of Squidblacklist.org. Available for immediate download, our new and unique “Terrorism and Extremism” Domain Blacklist. Available now for all current and new subscribers. As is always, we have formatted this blacklist for use with multiple platforms.

DNS Zone format, RouterOS DNS and Web Proxy *RSC import script, Squid Proxy Native ACL format, as well as plain text Dansguardian/SquidGuard Compatible format for use with all other web filtering platforms and applications.

Subscribe today and find out why so many have switched. Shouldnt you be using a higher class blacklist?

We are committed to continually evolve the technology we are using on the backend to produce ever increasingly better publications, We are proud to consistently bring ever more refined and simply the highest quality blacklists available.


Subscribe Now For Zone Access.

Flat rate subscription. For full access to all of our works, select a membership option & subscribe today.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now available.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.


New Option Available for Urlblacklist/Shallalist Compatible Platforms!


We heard you loud and clear, you wanted our enhanced blacklists in a similar archive/file structure as shallalist & urlblacklist for your web filtering platform, so we finally did it!

pfSense Blacklist Update
pfSense Blacklist Update

Available now to all squidblacklist.org members is the new “Universal Archive Structure Format” for any platform coded for shallalist or urlblacklist file structured archives!
Untitled

This new option is available for immediate download to all Squidblacklist.org visitors in the members area of the website, a subscription is required.

Untitled2

Enhance your web filtering strategy with enhanced blacklists and subscribe today.


Blacklisting has Evolved. Subscribe Now!

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now available.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.


Music website/domain blacklist for content filtering published.

We have had a video, and an image blacklist for a while now, so it only seemed right to include a music blacklist. This became clear as it was requested by one of our current members who is responsible for content filtering at an educational facility.

The new Music domain blacklist for web filtering purposes has been added to our existing line up and is available in the ‘all’ archive as well as standalone download, just as you would expect any other blacklist that we offer, this blacklist is also available in multiple formats for broad compatibility with most content filters and url filtering platforms and applications.

Enhance your web filtering strategy with enhanced blacklists and subscribe today.


Blacklisting has Evolved. Subscribe Now!

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now available.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.


Case Study – Web Filtering & Blacklist Quality Put To The Test.

DSC00728
Web filtering is an important consideration for any enterprise – it is one of the best-known and most efficient front line defenses against hacker attacks and malicious software. One of Squidblacklist.org customers was using a solution from another vendor which had reached end of life and needed to be replaced.

The system had not been performing to the customerā€™s satisfaction – it had proven difficult to manage, was not cost-effective, and its limited reporting capacity required an additional application to fill in the gaps in its functionality.

The client carried out an independent evaluation and selected two blacklist providers for deployment on separate Internet links to test the varying degrees of effective filtering. Filtering policies were created based on group membership rather than individual user rules as in the previous installation, and were integrated into Active Directory.This allowed existing support staff to grant Internet access by moving users into relevant Active Directory groups rather than modifying the proxy server configuration.

Improved Web Filtering Performance

Not only did the new Blacklists from Squidblacklist.org enhance the effective application of these appliances and the performance of web filtering for the customer, they also identified a number of websites which had been previously been mistakenly blocked or likewise, websites that should have been block, not blocked at all. The client was thus able to advise the relevant organizations – which included their customers and partner organizations – that their web filtering solutions had been compromised by poor quality blacklists from websites like shalla “secure services” and urlblacklist. These issues were then easily resolved by converting to blacklists by Squidblacklist.org.

The enhanced blacklists also introduced Weaknetlabs Technology which combines the best of conventional tools with new intelligent identification algorithms. ADR automatically tracks and adds or removes different domains. More effectively producing higher class of blacklists, than first generation blacklists from other providers. It also removes the inherent weaknesses in using human-only classification to give you the most up-to-date URL blocking and control.

The customer has since found that this new setup meets their requirements to an infinitely higher degree than their previous setup.


Blacklisting has Evolved. Subscribe Now!

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now available.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.


Domain Whitelist For Content Filtering Published

Our domain whitelist for content filtering purposes is now available for public access.

 

This whitelist does not contain any torrent or porn sites and should provide a good baselineĀ  whitelist for general audiences.

 

It can be downloaded here.


Subscribe Today – Paypal or Credit Card Accepted.

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now vvailable.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.

New DansGuardian Blacklist Update Script – by Brock M. Tice

DansguardianBrock M. Tice has generously taken the time to completely rewrite a new and superior update script for use with our blacklists and DansGuardian, and we have replaced the old script with this one, as there is essentially no use for the old one as this is far superior, and here it is.

 

It is also available for download compressed here.

 

#! /bin/bash
#
# DansGuardian Blacklist Updater Script v0.2 - Squidblacklist.org
# Thoughts or suggestions can be emailed to webmaster@squidblacklist.org
# 0.1->0.2 parameterization by Brock M. Tice
#
# Use this script to download and update blacklists for squid3 proxy
# You may need to edit this for your specific environment.
# you may optionaly wish to crontab this job so it will update at regular intervals
#
# Place this script within /etc/dansguardian/ directory
# Next, chmod +x squid-update.sh .That will make the script executable.
#
# nano /etc/crontab and add the following line
# 01 0 * * * root /etc/dansguardian/squid-update.sh
#
# Available ACLs:
#
# all
# prime
# malicious
# usg
# piracy
# porn
# dating
# ads
# proxies
# gaming
# smedia
# gambling
# cp
# blasphemy
# file
# image
# video
# pharma-rx
# new-tlds
# chanology
# dyn
# freeweb
# racism

# This is the base url for the lists -- do not edit
BASEURL=http://www.squidblacklist.org/downloads/squidblacklists/dg/

# Place the names of the sub-lists you want here, syntax enabled=( list1 list2 list3 ... listN )
enabled=( prime malicious piracy porn dating ads proxies gaming gambling cp pharma-rx chanology racism )

# squidblacklist.org username
USERNAME=userhere
PASSWORD=passhere
LISTBASE=/etc/dansguardian/lists/blacklists/

# enable dansguardian blacklist include line output
DGINCLUDEFILE=/etc/dansguardian/squidblacklist-includes.list
echo > "${DGINCLUDEFILE}"

echo Beginning squidblacklist.org Dansguardian Blacklist Update procedure... ;
cd /etc/dansguardian/ ;
echo Downloading blacklists...

# This loop uses the "enabled" list and the BASEURL to download, decompress, and move the list to the proper place for each specified list
# echos are temporary for testing
for listname in ${enabled[@]}; do
BASENAME="dg-${listname}"
wget --http-user="${USERNAME}" --http-password="${PASSWORD}" --auth-no-challenge "${BASEURL}${BASENAME}.tar.gz"
tar -xvf "${BASENAME}.tar.gz"
if [ ! -d "${LISTBASE}${listname}" ] && [ ! -f "${LISTBASE}${listname}" ]; then
mkdir -p "${LISTBASE}${listname}"
elif [ -f "${LISTBASE}${listname}" ]; then
printf "WARNING: Skipping list %s, %s already exists but is not a directory\n" "${listname}" "${LISTBASE}${listname}" >&2
continue
fi
mv "${BASENAME}.acl" "${LISTBASE}${listname}/domains"

# update include file
echo ".Include<${LISTBASE}${listname}/domains>" >> "${DGINCLUDEFILE}"

rm "${BASENAME}.tar.gz"
done

echo "Reloading Dansguardian Service... "
service dansguardian restart
echo "Done."

echo "If you have not already, add .Include<${DGINCLUDEFILE}> to your /etc/dansguardian/lists/bannedsitelist>"


Subscribe Today – Paypal or Credit Card Accepted.

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now available.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.

How To Update Blacklists For DansGuardian – Update Script

I just tossed together a simple bash script for updating Blacklists from Squidblacklist.org for DansGuardian under GNU/Linux or I suppose any platform with a bash shell would suffice, it isnt really that sophisticated, it is rather crude and gets the job done.

The blacklist update script for DansGuardian can be downloaded here. Remember that a valid username and password will be required for basic http authentication. To download these files one must subscribe. Get your own username and password today by subscribing to Squidblacklist.org here..

Here is the blacklist update script in plain text form.


#! /bin/bash
#
# DansGuardian Blacklist Updater Script v0.1 - Squidblacklist.org
# Thoughts or suggestions can be emailed to webmaster@squidblacklist.org
# You will need to change the wget line with your user account for authentication
#
# EXAMPLE:
# wget --http-user=USERNAME --http-password=PASSHERE --auth-no-challenge http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-prime.tar.gz
#
# Use this script to download and update blacklists for squid3 proxy
# You may need to edit this for your specific environment.
# you may optionaly wish to crontab this job so it will update at regular intervals
#
# Create the directories you want
# EXAMPLE: 'mkdir /etc/dansguardian/lists/blacklists/porn'
#
# Place this script within /etc/dansguardian/ directory
# Next, chmod +x squid-update.sh .That will make the script executable.
#
# nano /etc/crontab and add the following line
# 01 0 * * * root /etc/dansguardian/dg-update.sh
#
# URLS for DG ACL blacklists Are listed below.
#
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-all.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-prime.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-malicious.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-usg.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-piracy.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-porn.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-dating.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-ads.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-proxies.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-gaming.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-smedia.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-gambling.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-cp.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-blasphemy.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-file.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-image.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-video.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-pharma-rx.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-new-tlds.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-chanology.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-dyn.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-freeweb.tar.gz
# http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-racism.tar.gz
#
# Happy Updating.

echo Beginning squidblacklist.org Dansguardian Blacklist Update procedure... ;
cd /etc/dansguardian/ ;
echo Downloading blacklists...
# Easy to download blacklists, decompress and move to the proper directory.
wget --http-user=USERNAME --http-password=PASSHERE --auth-no-challenge http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-porn.tar.gz ;
tar -xvf dg-porn.tar.gz ;
mv dg-porn.acl /etc/dansguardian/lists/blacklists/porn/domains ;
wget --http-user=USERNAME --http-password=PASSHERE --auth-no-challenge http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-ads.tar.gz ;
tar -xvf dg-ads.tar.gz ;
mv dg-ads.acl /etc/dansguardian/lists/blacklists/ads/domains ;
wget --http-user=USERNAME --http-password=PASSHERE --auth-no-challenge http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-malicious.tar.gz ;
tar -xvf dg-malicious.tar.gz ;
mv dg-malicious.acl /etc/dansguardian/lists/blacklists/malicious/domains ;
wget --http-user=USERNAME --http-password=PASSHERE --auth-no-challenge http://www.squidblacklist.org/downloads/squidblacklists/dg/dg-chanology.tar.gz ;
tar -xvf dg-chanology.tar.gz ;
mv dg-chanology.acl /etc/dansguardian/lists/blacklists/chanology/domains ;
echo Cleaning up temporary files... ;
rm *.tar.gz ;
echo Reloading Dansguardian Service... ;
service dansguardian stop ;
service dansguardian start ;
echo Done.


Subscribe Today – Paypal or Credit Card Accepted.

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now vvailable.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.