Tag Archives: domain blacklist

New Option Available for Urlblacklist/Shallalist Compatible Platforms!


We heard you loud and clear, you wanted our enhanced blacklists in a similar archive/file structure as shallalist & urlblacklist for your web filtering platform, so we finally did it!

pfSense Blacklist Update
pfSense Blacklist Update

Available now to all squidblacklist.org members is the new “Universal Archive Structure Format” for any platform coded for shallalist or urlblacklist file structured archives!
Untitled

This new option is available for immediate download to all Squidblacklist.org visitors in the members area of the website, a subscription is required.

Untitled2

Enhance your web filtering strategy with enhanced blacklists and subscribe today.


Blacklisting has Evolved. Subscribe Now!

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now available.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.


Music website/domain blacklist for content filtering published.

We have had a video, and an image blacklist for a while now, so it only seemed right to include a music blacklist. This became clear as it was requested by one of our current members who is responsible for content filtering at an educational facility.

The new Music domain blacklist for web filtering purposes has been added to our existing line up and is available in the ‘all’ archive as well as standalone download, just as you would expect any other blacklist that we offer, this blacklist is also available in multiple formats for broad compatibility with most content filters and url filtering platforms and applications.

Enhance your web filtering strategy with enhanced blacklists and subscribe today.


Blacklisting has Evolved. Subscribe Now!

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now available.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.


Using Squidguard and Pfsense to Url Filter with Domain Blacklists from Squidblacklist.org

Using Squidguard and Pfsense to Url Filter with Domain Blacklists.

pfsense Logo

URL filtering is one strategy used to filter access to websites based the domain name and/or url. There are several commercial products available for URL or domain content filtering, but you could easily build a very reliable system on your own using SquidGuard and pfSense. SquidGuard is a useful add on package for the Squid proxy server and can be used to filter or redirect web requests on the network.

SquidGuard has a long list of features that can be tailored to fit your needs. It’s also rather fast and does’nt slow down the internet for your clients. If you do need to block access to a list of unwanted websites or only allow access to a whitelist of specific web sites, SquidGuard can certainly assist with this.

SquidGuard is also very flexible, and it is easy to adapt to different applications. If you intend to do basic URL filtering on your home network or if you need to create some complicated rules for a large private or public network SquidGuard can do it.

Before you can put a web filtering proxy under pfSense into production, some configuraation is required. If you are new to pfSense I might recommend reading through the instructions that shit with pfSense.

Install the package SquidGuard Package

SquidGuard & Squid proxy can both be installed using the pfSense package manager. To access the pfSense package manager, click packs on the system menu. Select the tab available packages and scroll down where you will find SquidGuard and Squid proxy individually, click the plus sign next to each item to begin the installation.

Once the installations are complete you will have a new menu item called proxy services/filter.

Blacklists

To set up domain blacklist, open the general settings page ‘Filter Services & Proxy’. Click the checkbox to activate the domain blacklist.

You can use one of several different domain black lists publicly available on the web. You can also find a list of several blacklists from http://www.squidblacklist.org. We have our blacklists available in multiple formats, but likely, youll want the standard directory formatted archives located at the following url. http://www.squidblacklist.org/downloads/squidblacklists/squidblacklist.tar.gz


Subscribe Today – Paypal or Credit Card Accepted.

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now available.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.


Excluding URL blacklist

There may be some places that you need to allow your users to access. To prevent these sites from locking can create a new category of destination and add a list of domains or URLs that should not be blocked.

To do this click the target categories tab, and then click the plus sign to add a new category. You must assign a unique name to the new category, the name you choose can not contain spaces.

The target category can filter by domain name, URL, or an expression. Add a domain site will grant access to the main site and all its sub-pages. Entering a URL allows access only to that exact website. Expressions allow you to grant based on certain keywords access.

When finished, click Save, and then back to the common ACL tab or group (wherever that created the rule) and select and action whitelist for your new category.

You can also use this same method to add additional sites to its blacklist.

Filtering by Expression

In addition to the domain and URL filtering SquidGuard can create filters using regular expressions. These types of filters are great when you want to search for specific text strings in a URL to make a decision for this search. If you are unfamiliar with regular expressions can be a bit confusing at first, but there are many online resources on the subject, so I will not go into much detail about them in this article.

To create a filter that uses an expression, click the target categories tab, or create a new category or edit an existing one. Enter the expression you want to filter in the expression box and then click Save. Then go back to the common or group ACL tab and select the action (deny, permit, etc.) for your target category.

Here are some examples of filter expressions are presented. These can be edited according to what to filter. For more useful information about filtering regular expressions http://www.squidguard.org/Doc/Examples review.

Downloads based on file extension block

(* \ /.* \ (Zip | .. Rar | exe | msi | mpeg | avi))

Block certain TLDs

(.gov | .xxx | Mil | .net)

Block search “bypass proxy” on Google and Yahoo

(.*(google|yahoo).*(search_query|keywords|search|query|q|p)=.*(\+|\%20)*(proxy|bypass).*(\-|\+|\%20).*(proxy|bypass).*)

Programming rules & Time-based rules

SquidGuard also allows you to apply URL filtering based on schedules. Times are useful for applying rules at different times during the day, or only on certain days of the week.

For example, you could apply URL filtering rules strict office hours and automatically disable the rules after 17:00. If you are filtering your home network you may not want the children to visit certain sites during the school week, this is another example in which a time-based rule would be used.

To create a rule-based time, click the time tab and then click the plus sign to create a new schedule. You can create as many different times as you need.

Schedules can be applied using the ACL Groups tab. Create a new ACL or edit an existing group, then click the “time” drop-down box select the schedule you created.

Do not forget to click Apply on the General tab for the settings to take effect.

Conclusion

Commercial Web filtering devices can be very expensive and difficult to handle. PfSense SquidGuard and are completely free and very powerful. SquidGuard offers many other features that are not covered in this center. For more detailed information, visit SquidGuard.org and check out the documentation section. Also be sure to check out some of my other centers to learn about more ways to use pfSense on your network.
Guidelines pfSense

pfSense Bandwidth – Setting Traffic Shaping
Heavy users wide band can slow the entire network. This center will show you how to use pfSense to set traffic shaping to prioritize Internet traffic.
Dual Wan Router – How to load balance with pfSense
Dual WAN Routers allow you to increase the bandwidth of the Internet on your network by combining two Internet connections. Using pfSense can turn an old computer into a powerful multi WAN router.
How to set up a transparent proxy using squid pfSense
Proxy servers can be very useful for improving the speed of an Internet connection by caching, log Internet usage, or filter traffic. Learn how to set up a transparent proxy using pfSense.

How to setup and use Blacklists with Websense and Squidblacklist.org.

How do I set up a filtering blacklist with Websense & Squidblacklist.org?

Websense Web Filter
Websense Web Filter

Applies To:Websense Web Filter, Web Security, Web Security Gateway, and Web Security Gateway Anywhere Version 7.6

Step 1.
Download and decompress blacklists from Squidblacklist.org by singing up for an account here. Fees apply.

Step 2.
The easiest way to block (or “blacklist”) a list of URLs is to create a custom category and recategorize the URLs you want to block into that category.

Step 3.
On the Policy Management > Filter Components > Edit Categories > Add Category page add a category name, description and parent category (optional).

Step 4.
Enter the sites (URLs or IP addresses) that you want to add to this category.You can also edit this list after creating the category.

Step 5.
Select Block as the default filtering Action to apply to this category in all existing category filters.

Enable any desired Advanced Filtering actions (optional). Then click OK to cache your changes. Changes are not implemented until you click Save All.


Subscribe Today – Paypal or Credit Card Accepted.

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now available.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.


Mikrotik RouterOS Blacklist Validation Testing & Compatibility Chart Update Posted.

logo_new800

CCR1036-12G-4S & Porn Blacklist
CCR1036-12G-4S & Porn Blacklist

We have retooled our backend logic which has had a dramatic impact on the size and contents of our blacklists, just another reason for us to retest the RouterBoards we have available to see which blacklists are able to run on them and which ones cannot.  We posted the results of our findings in the following chart.

Mikrotik 951G-2HnD
Mikrotik 951G-2HnD

We also added two new routers to the chart, the map2n and 951G-2HnD.  Which we recently received for testing. We have prepared a compatibility chart for your review.

Mikrotik RBmAP2n
Mikrotik RBmAP2

 

 

Mikrotik compatible conversions of our blacklists are available to all subscribers in .rsc import script formats for both Mikrotik Web Proxy Access Blacklist and Mikrotik DNS Access Blacklist. Subscribe Now.

Test it for yourself! Download this sample Mikrotik Web Proxy blacklist tik-ads.rsc


Subscribe Today – Paypal or Credit Card Accepted.

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now vvailable.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.

India Government Porn Blacklist Leaked.

Internet-Censorship-IndiaA Botched Attempt to block Porn and  CP.  Files Leaked…. 


 

The Indian Government ordered local internet service providers to begin blocking a list of 857 adult websites that purportedly hosted or linked illegal adult material as well as otherwise legal porn. The broad blocking order went further than targeting dedicated porn sites alone though. Many websites that should not have been a part of the blacklist block were. Including  torrent sites like kickass.to & h33t.to were listed, as well as 9Gag, Liveleak and CollegeHumor.

Untitled

In  July 2015,  millions of Indian Internet users starting to notice that favorite sites werent  accessible. On a Friday, the Government ordered local ISP’s to filter content access to a the blacklist of 857 websites, including many of the top adult sites.

“Your requested URL has been blocked as per the directions received from Department of Telecommunications, Government of India,” was the warning banner users got to see instead of the pages they intended to visit.

The move has sparked outrage among the public, who condemn the Government for censoring the Internet without proper cause. According to the court order the sites are being blocked because they threaten the morality and decency of Indians, which a local official has now confirmed.

“Free and open access to porn websites has been brought under check. We don’t want them to become a social nuisance,” a spokesman at the Department of Telecommunications told Reuters.

The Government order is quite broad, and not just because of the high number of domain names involved. A leaked copy which list all of the affected domains reveals some unsuspected entries.

For example, the list contains two of the largest torrent sites, Kickass.to and H33t.to. The first is now operating under the new Kat.cr domain name and the latter site is down, so the effects of the blockade are minimal.

 

While blocking these torrent sites may be justified as both sites do link to pornographic content, the same can’t really be said for CollegeHumor and 9Gag, which are also on the blacklist.

The same goes for Liveleak, which has plenty of ‘immoral’ videos but isn’t really known for its vast amounts of porn. Finally, the list also includes nonvegjokes.com, a site specializing in dirty jokes.

The blocking order was issued under Rule 12 of the local Information Technology Rules, which allows the Government to block access to sites that are deemed to violate the integrity or security of India.

The Government still has to justify its blocking request before the end of the month. If those arguments prove insufficient, the court order may be overturned again. In the meantime, the interest in circumvention tools such as VPN services and proxy sites is expected to skyrocket.

Update August 5: The porn block has been lifted already. But the blacklist was leaked, see below for a link to download the pdf.

 

Leaked Indian Government Blacklist file is available for download –> 2015-07-31-dot-block-order-decency.pdf


Subscribe Today – Paypal or Credit Card Accepted.

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now vvailable.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.

Free blacklists suck , and heres why.

Squidblacklist.org – Blacklisting Has Evolved.

Normally I would believe free is great, free as in, gratis. However, when it comes to the blacklists freely available online, specifically, blacklists tailored for consumption as an important web filtering component used in various content filter hardware platforms and software applications. The free solutions just dont cut it. And If you as an administrator can find as many holes within just a few simple Google searches using the free blacklists, just imagine how easy it will be for a determined end user on your network to find and access unauthorized content.

snakeoil
One can easily load up their content control platform of choice with any of the freely available blacklists and with just a few simple Google searches, one can easily find many websites not included in those free blacklists. Many websites will easily load, exposing the fact that many of these blacklists are poorly maintained, and result in an unreliably poor degree of quality.

Not only are these blacklists highly inadequate, they are generally, all filled with errors, erroneous characters, blank spaces, formatting issues, capitalization mistakes,  etc, etc.

It is not uncommon for many administrators who fail to achieve an effective degree of content control using open source platforms, combined with low cost solutions, such as free domain blacklists. Many times concluding their efforts in frustration at the lack of efficacy and are forced to turn to much more expensive content control solutions from large vendors. This is why we believe that the world is primed and ready for a higher quality value added blacklist solution, and Squidblacklist.org intend’s to fill this gap.

This is why we founded Squidblacklist.org, as a paid service, which allows us to allocate our resources to pursue and continue producing blacklists of a much higher quality, with a level of sophistication in our production and validation processes that is seriously lacking in other, competing solutions..

Regardless of whether it is paid or gratis, we intend to beat our competition, as we continue to uphold our reputation as The Worlds Leading Publisher of Blacklists Tailored Specifically for use with Content Filering platforms.


Subscribe Today – Paypal or Credit Card Accepted.

Flat rate subscription. Select a membership option & subscribe.



Select Payment Option



  • You will be issued a username and password.
  • You will be granted access to our member area.
  • 5 Year Membership Option now vvailable.
  • For lifetime membership options click here.clipart
  • Contact us if you would like a pre order invoice.

Disclaimer: All sales are final, we do not issue refunds. Cancel your subscription anytime.