November 25 2013. We added a search input field on the top left to quickly find events that interest you. Simply separate multiple search strings with a space. For example, bitorrent inbound would search for all events containing the words bittorrent and inbound. You can also specify partial or fully specified IP addresses like 192.168.1. or 192.168.1.1 as part of the query to look for specific IPs.
WakingShark II: Stress Testing the City of London
The City of London underwent a massive cyber attack- on purpose! In a great feat of preemptive security hundreds of people, from hackers to holy grail financial institutions, participated in a collaborative attack to test various organizations and government institutions’ preparedness. More cities and organizations should be testing their mettle in such a way.
Waking Shark II – Stress Testing the City of London
See how the MetaFlows Security System can put your network to the test. Find out what you are not seeing in our Free 14 Day Trial.
Better Logging
November 8 2013. Snort now logs in unified2 format which should give better logging of the offending packets. When a packet query comes in, the sensor automatically translates unified2 to pcap and then searches for your data.
Security and The Internet of Things
In a world where, increasingly, EVERYTHING is linked together by internet, bluetooth, and technology at large, security is at its utmost importance. However- and who is to say whether we choose ignorance as bliss or just are too trusting- many do not even realize how much of their private lives are basically on a buffet table at a party hosted by Internet.
An interesting look at the expansion and effects of “The Internet of Things.”
Insecurity and the Internet of Things Part 1: Data, Data Everywhere
Feature Spotlight: Global Enterprise Solution
Global Enterprise Solution
The MSS Global Enterprise (MSS GE) is a complete turn-key security system intended for large Enterprise or Government networks, and includes advanced Malware/Botnet detection, Intrusion Prevention, Log Management/SIEM, and integrated vulnerability assessment. The MSS GE controller can be deployed either as a high performance Appliance (starting at 1200 Events/Second) or as an Amazon EC2 instance (AMI). The MSS GE sensors can be easily provisioned on off-the-shelf hardware (up to 10 Gbps per sensor) running Linux CentOS/RedHat, high-performance Appliances, VMware or on Amazon EC2.
Web Security Console
| MSS GE Controller
| Daily Intelligence Feeds
|
False Positives: A Contradiction Most Annoying
False Positives are the thorn in the backside of every IT security professional. The following article does a good job of breaking them down and explaining some of their greater risks.
False Positives are all but eliminated by the MetaFlows Security System. A fact that seems to good to be true, but is made totally possible by innovative technology!
Old Dog, New Tricks: Reengineering Human Behavior Can Foil Phishing
No, UPS does not have a package waiting for you and that prince in Nairobi does not really want to give you $50,000, no matter how well thought out his plan is.
The article below details how, with just a bit of training, even your typical end-user can become more savvy and avoid those pesky phishing emails, thus saving your network from nonsense.
Reengineering Human Behavior Can Foil Phishing
Find out how the MetaFlows Security System, by utilizing Network Level AntiVirus and an Internal File Carver, can notify on and prevent pesky phishing scams.
And Now For Something Completely Technical: PF Ring 10 Gbps Snort IDS
You can always visit the MetaFlows Website for more information.
PF_RING based 10 Gbps Snort multiprocessing
Tested on CentOS 6 64bit using our custom PF_RING source
PF_RING load balances network traffic originating from an Ethernet interface by hashing the IP headers into N buckets. This allows it to spawn N instances of Snort, each processing a single bucket and achieve higher throughput through multiprocessing. In order to take full advantage of this, you need a multicore processor (like an I7 with 8 processing threads) or a dual or quad processor board that increases parallelism even further across multiple chips.
In a related article we measured the performance of PF_RING with Snort inline at 1 Gbps on an I7 950. The results were impressive.
The big deal is that now you can build low-cost IDPS systems using standard off-the-shelf hardware.
You can purchase our purpose-built Hardware with MetaFlows PF_RING pre-installed, giving you a low cost high performance platform to run your custom PF_RING applications on. If you are interested in learning more, please contact us.
In this article we report on our experiment running Snort on a dual processor board with a total of 24 hyperthreads (using the Intel X5670). Besides measuring Snort processing throughput varying the number of rules, we also (1) changed the compiler used to compile Snort (GCC vs. ICC) and (2) compared PF_RING in NAPI mode (running 24 Snort processes in parallel) and PF_RING Direct NIC Access technology (DNA) (running 16 Snort processes in parallel).
PF_RING NAPI performs the hashing of the packets in software and has a traditional architecture where the packets are copied to user space by the driver. Snort is parallelized using 24 processes that are allowed to float on the 24 hardware threads while the interrupts are parallelized on 16 of the 24 hardware threads.
PF_RING DNA performs the hashing of the packets in hardware (using the Intel 52599 RSS functionality) and relies on 16 hardware queues. The DNA driver allows 16 instances of Snort to read packets directly from the hardware queues therefore virtually eliminating system-level processing overhead. The limitation of DNA is that (1) supports a maximum of 16x parallelism per 10G interface, (2) it only allows 1 process to attach to each hardware queue and (3) it costs a bit of money or requires Silicom cards(well worth it). (2) is significant because it does not allow multiple processes to receive the same data. So, for example if you run “tcpdump -i dna0″, you could not also run “snort -i dna0 -c config.snort -A console” at the same time. The second invocation would return an error.
GCC is the standard open source compiler that comes with CentOS 6 and virtually all other Unix systems. It is the foundation of open source and without it we would still be in the stone age (computationally).
ICC is an Intel proprietary compiler that goes much further in extracting instruction- and data-level parallelism of modern multicore processors such as the i7 and Xeons.
All results are excellent and show that you can build a 5-7 Gbps IDS using standard off-the-shelf machines and PF_RING. The system we used to perform these experiments is below:
The graph above shows the sustained Snort performance of 4 different configurations using a varying number of Emerging Threats Pro rules. As expected, the number of rules has a dramatic effect on performance for all configurations (the more rules, the lower the performance). In all cases, memory access contention is likely to be the main limiting factor.
Given our experience, we think that our setup is fairly representative of an academic institution we have to admit that measuring Snort performance in the absolute is hard. No two networks are the same and rule configurations vary even more widely, nevertheless, the relative performance variations are important and of general interest. You can draw your own conclusions from the above graph; however here are some interesting observations:
- At the high end (6900 rules) ICC makes a big difference by increasing the throughput by ~1 Gbps (25%)
- GCC is just as good at maintaining throughput around 5 Gbps
- PF_RING DNA is always better than PF_RING NAPI.
We describe below how to reproduce these numbers on Linux CentOS 6. If you do not want to go through these steps, we also provide this functionality through our security system (MSS) pre-packaged and ready to go. It would help us if you tried it and let us know what you think.
Got Torrents?
September 26 2013. We now log all Bittorrent uploads and downloads (including the ones initiated using magnet links). Additionally, we have added a menu item called Files to the historical menu to make searching for all file transfers a bit easier; you can create classifications to easily find or email torrent transfers using a regex match on the Log Events field; just look for “torrent”.
Information Breach Tragedy: It Could Have Been Avoided Completely!
A University employee single handedly demonstrates why it’s just as important to know what’s leaving your network as it is to know what’s coming into it!
University Employee Fired for Inadvertently Emailing Student Data
Find out how the MetaFlows Security System can monitor important files leaving your network, and catch them before they make it out!