Wrong Music began life as an improvised noise/breakcore/gabba night at the Freebutt, Brighton. It was founded by Henry Collins (Shitmat), Shige Isihara (DJ Scotch Egg), Matt Lambert (Roger Species), and Ben Hudson (Ebola/ Chezny Hawkes) and over the past few years has hosted a bunch of wonderfully obscure acts. Ranging from ultra high tech spazcore breaks to low-fi noise, from breakcore to midi-karaoke, Wrong Music has seen everything from root vegetable wielding farmers playing ragga jungle to a very special adaptation of the nativity play.

The record label was started by Collins in collaboration with other Brighton based artists in 2005 as an offshoot of the local club night. The label specialises mainly in releases by offbeat ("wrong") electronic artists, often making use of samples. Besides Shitmat himself, the label is also home to DJ Scotch Egg and Ladyscraper.