• Color Grading & Restoration
  • Blog
  • ABOUT
  • Contact
Menu

Zachary Halberd

  • Color Grading & Restoration
  • Blog
  • ABOUT
  • Contact

Video Noise and the Origins of Our Universe

January 27, 2021

Written by: Zachary Halberd

 

Approximately ten seconds after the Big Bang birthed our reality, experts tell us that the universe was dominated by a single form of energy: the photon. This period, known as the Photon Epoch, lasted about 370,000 years until the universe cooled to a temperature which allowed for atomic nuclei and electrons to combine. The great Recombination of what we now call matter began to starve the photons of their rule by removing their ability to interact energetically with electrons and protons. As an isotropic fog of nuclei and electrons began to congeal into matter, the entire universe finally became transparent. Though photons had lost their source of high energy, they were now free to travel the infinite expanse for the remainder of time.

On May 20th, 1964 radio astronomers Robert Wilson and Arno Penzias were conducting an experiment with Bell Laboratories on a hilltop in New Jersey. Their instruments had been specifically designed to eliminate as much electromagnetic interference and noise as possible such as other radio signals, power lines, and even microwave ovens and medical equipment. In order to conduct the first experiment involving human voice transmission through space to another location on Earth, it was critical for the research team to be able to separate a voice signal from the noise coming from the world around them. It was the first satellite telecommunications system in human history and there were many telecommunications companies both at home and abroad that had an interest in the experiment’s success. Telephone communications systems were being installed in nearly every country in the world, and not unlike the birth of the internet several decades later, new markets were waiting to thrive on humanity’s desire for instantaneous global communication and information.

 
Wilson and Penzias, 1965

Wilson and Penzias, 1965

 

However, during the experiment Wilson and Penzias noticed something strange. After installing the world’s most sensitive radio receiver specifically designed to remove almost all noise, there was still a consistent random noise present in the instrument. The research team submerged their receiver in liquid helium in order to bring it down to near absolute zero and eliminate thermal noise. They constructed a special horn antenna that was designed to mask out human-generated electromagnetic interference. They even placed the antenna on top of a hill in a remote area, but the noise was still present. In what would eventually become a Nobel Prize discovery on the nature of the cosmos, Wilson and Penzias determined that the noise was, in fact, the ancient remnants of the electromagnetic energy released during the Big Bang. Scientists now call this the Cosmic Microwave Background Radiation (CMBR). This relic radiation is all around us and permeates through us. If the universe were a colossal gong, the CMBR would be the veritable electromagnetic tone after the strike of the Big Bang itself still resonating and giving humanity the opportunity to listen and record it for analysis. Sadly, our universe is expanding and as the fabric of reality dilates, so does the wavelength of these primordial photons. The wavelength of a photon’s propagation is inversely proportional to it’s energy, so over time the tone of our cosmic birth will grow so faint that it will be lost forever.

Signals from Outer Space

Most of you who are reading this article are likely to have been around when the United States switched off analogue television broadcasting in the summer of 2009. The great migration to digital cut most of us off from daily interaction with cosmic noise as advanced appliances began to use sophisticated methods of filtering out unwanted interference. When we switched off analogue television and radio, we effectively ended an era of household radio-telescopes. If you have the urge to witness this cosmic cacophony yourself, you may want to pick up an old analogue television and turn it on. To the unfamiliar, the static that ensues will most certainly be a bizarre sight. In America some might call this the “snow” effect. The Danish call this visual noise “war of the ants”. The Indonesians call it “ant soccer” and some further East call them “fleas”.

 
Typical noise pattern of an analogue television channel

Typical noise pattern of an analogue television channel

 

Once society began to digitize, we became obsessed with clean video and audio signals. CDs, DVDs, and MP3 files were marketed as flawless digital facsimiles of live and studio recordings from our favorite artists. Today, video has become clean and crisp as has photo and audio. Higher resolution digital formats requiring more complex noise reduction algorithms have driven market standards and have become our default mode for viewing and listening. Camera manufacturers have poured billions of dollars into higher resolution formats and the war against noise. The digital imaging processor has come a long way since it’s mainstream debut in the early 2000s having been developed, in part, to parse unwanted noise from a recorded image. Although the vast majority of this noise is due to thermal radiation and human generated electromagnetism from other electronics, about 1% of this persistent nuisance is from CMBR. The technical definition of a signal is: “a function that conveys information about a phenomenon.” In other words, a signal is information that we’re able to extract from random chaos. The quality of a signal vs the noise that it must contend with is known as the signal to noise ratio (SNR). As our species continues to expand its electromagnetic footprint, video equipment manufacturers have been locked in an arms race against our own planetary background radiation. If we could actually listen to electromagnetic radiation here on earth with unaided ears, this little blue marble that we live on would sound like the Yankees stadium during the World Series. Even in the most remote regions on Earth one can turn on a radio and hear the snap and crackle of a radio wave.

 
Example of a signal standing above the “noise floor” (noise highlighted in red)

Example of a signal standing above the “noise floor” (noise highlighted in red)

 

Sleight of Hand

It’s somehow comforting to know that something as awesome as the birth of our universe plays a daily role in my life and work. As a colorist for film and television, I work closely with digital video down to the pixel level on a daily basis. I’m often working at high magnifications, deep within the smaller sectors of a video frame in order to diagnose issues like chromatic noise (yes, noise comes in different colors!), color cast, macro blocking from compression, dead pixels, banding, moire, and other strange and wonderful phenomena. Living this closely to the image, I can get a much better sense of a camera’s personality. Over the years, I’ve come to fall in love with digital video and all of its flaws, video noise notwithstanding. Working for years at high magnification of a video frame has given me a much better appreciation for the scientific and engineering challenges that digital imaging experts have managed to overcome or, more importantly, circumvent. Every digital camera in the world, regardless of price or sophistication, exhibits the same characteristic: trickery.

Consider Georges Seurat’s pointillist masterpiece A Sunday Afternoon on the Island of La Grande Jatte. Upon first entering a large gallery in the Art Institute of Chicago earlier this year, I saw this large painting mounted to the wall and surrounded by onlookers who were standing at various distances in an attempt to resolve more and more detail. From afar, the work looks smooth and flawless with imperceptible gradations in color and tonality. Exquisite though the work might be from afar, upon closer inspection one can see the hundreds of thousands of “imperfections” that collectively form a reality. What might seem like chaos at high magnification forms recognizable constructs like the human form or a sailboat on the water.

 
Seurat, Georges. A Sunday Afternoon on the Island of La Grande Jatte. 1884. Art Institute of Chicago.

Seurat, Georges. A Sunday Afternoon on the Island of La Grande Jatte. 1884. Art Institute of Chicago.

Closer inspection of Seurat’s pointillist technique

Closer inspection of Seurat’s pointillist technique

Further magnification of Seurat’s pointillist technique

Further magnification of Seurat’s pointillist technique

1__v-zBNTOEX_XCgYYZ9RElA.gif
 

Human beings are both blessed and cursed with the special ability to recognize patterns in everything around us. Where there is disorder, we instinctively impart entropy. We see bunny rabbits in cumulus clouds and Mother Theresa in burnt toast. We owe this strange talent to our ancestors who for millions of years selected for the evolutionary trait that compels us to stare into the chaos of cool green foliage late at dusk in order to reveal the predators eyes peering back at us. There is great advantage to filtering out useless information that would otherwise overwhelm our senses and prevent us from recognizing what is most critical. In the early days of television, engineers designed clever methods of presenting realistic images using artificial means. Instead of millions of random pixels popping on and off our screens, all we see are recognizable objects interacting on larger scales.

I recorded a twelve-minute time-lapse of a sunset in Missouri and offer some magnified images of the noise for closer scrutiny below:

 
Frame exported from a time-lapse video of a sunset.

Frame exported from a time-lapse video of a sunset.

200x magnification

200x magnification

300x magnification

300x magnification

 
Low frequency

Low frequency

Medium frequency

Medium frequency

High frequency

High frequency

 

If you’re interested in seeing this painterly noise in action, I’ve uploaded the full twelve-minute time-lapse video that these stills were taken from at 300x magnification and placed it below. There’s no sound so I recommend listening to your own music while watching this clip. It’s mesmerizing effect is similar to that of a campfire. There is a rhythm to it as you will see as the image is consistently refreshed with the key frame. This video essentially represents 23.98 separate noise samples per second. Much of this “noise” is actually encoding blocks that have sampled and compressed groups of pixels in the original image along with its noise into larger blots (brush strokes?). It creates a staccato of color-blocks that vibrate throughout the screen in clumps that are considered to be medium to low frequency noise. This simmering proscenium of shape-shifting polygons when seen from a certain distance can morph into an infinite number of complex shapes. Spread out over enough time, like stop-frame animation, these strange replications can form a narrative.

 
 

The Million Year Sunset

Scientists say that there was a period after the Big Bang that lasted about one million years which cast the entire universe in what we would perceive today as a warm glow. Objectively, anything and everything that existed was hot enough to emit a beautiful 3000° Kelvin light that resembled the warm glow of the sunset time-lapse I’ve shared above. As space expanded, the energy was stretched like taffy and cooled in tandem. The light eventually became a deep crimson before falling out of the visible spectrum and into the abysmal depths of infrared. Fourteen-billion years have passed, and here we are today capturing and displaying imagery. The universe has expanded for so long and for such an immense volume that the primordial sunset has shifted into the much lower spectrum of microwaves. Astronomers have been using specially designed radio-telescopes which are able to observe into these deep radio spectra to better understand the structure of the cosmos.

 
1_jpYktUK7FMQQSxTNrteioA.png

Microwave images of the CMBR. Jason W. Henning. High Energy Physics Division. Argonne National Laboratory

 

Cosmologists today are not unlike an observer standing with their nose up against a Georges Seurat painting. Humanity is recording and measuring the vast tapestry that surrounds and composes our reality. Certain technical challenges like noise gives us more opportunity to innovate and explore the beauty of entropy. New tools and methods are emerging from the scientific realm which will offer future generations the opportunity to see the Universe for what it truly is. Perhaps given enough time, we might even be able to reconstruct the narrative of how we all got here.

← Image Calibration and a Brooklyn Homicide

Latest Posts

Featured
DOC_WORKFLOW_20240428.png
May 12, 2024
Documentary Finishing Workflow Demystified
May 12, 2024
Read more →
May 12, 2024
Using AI Models to Colorize Monochromatic Archival
September 30, 2022
Using AI Models to Colorize Monochromatic Archival
September 30, 2022
Read more →
September 30, 2022
Archival Restoration - Experimenting with Python Using VapourSynth + Resolve
October 25, 2021
Archival Restoration - Experimenting with Python Using VapourSynth + Resolve
October 25, 2021

Take a peak under the hood of my process to restore a heavily compressed archival film using the open source Python script-based image processing tool Vapoursynth.

Read more →
October 25, 2021
Qualitative Camera Test v2 - Summer 2021
October 25, 2021
Qualitative Camera Test v2 - Summer 2021
October 25, 2021

I convinced ten cinematographers to bring their cinema cameras to a qualitative camera test. Here are the results.

Read more →
October 25, 2021
axel-vazquez-nph6DcLTckI-unsplash.jpg
July 3, 2021
Premiere to Resolve and Back Again - A Remote Workflow Guide
July 3, 2021

For the love of God, please stop using shuttle drives. Just use the Resolve media manager to shrink ray your Premiere timeline down to a tiny portable file and send to your colorist!!! In this article, I show you how!

Read more →
July 3, 2021
VapourSynth Installation for Python 3.6.8
June 14, 2021
VapourSynth Installation for Python 3.6.8
June 14, 2021

My ongoing experiments with incorporating the Python-based image processing software, VapourSynth, into my color management and restoration pipeline has resulted in compiling a stable package which Windows users may use for further experimentation.

Read more →
June 14, 2021
Deconvolutional Upscaling for Legacy Media
February 9, 2021
Deconvolutional Upscaling for Legacy Media
February 9, 2021

MCM Creative in NYC reached out to Magic Lantern and asked if it was possible to clean up and upscale his feature doc Shelter Island prior to an Amazon streaming distribution sale. Unfortunately, the original media was no longer available and the master had already gone through various unknown encodes.

Read more →
February 9, 2021
Superior Deinterlacing and Upscaling With Machine Learning
February 2, 2021
Superior Deinterlacing and Upscaling With Machine Learning
February 2, 2021

Typically, filmmakers use the deinterlacing tool provided for free within their NLE or Davinci Resolve. This article will demonstrate why this approach can be destructive to the image and will offer a better alternative.

Read more →
February 2, 2021
Rendering With JPEG Compression(ism)
January 28, 2021
Rendering With JPEG Compression(ism)
January 28, 2021

A collection of photos taken with a cell phone at full magnification yields interesting results. Although the discrete cosine transform compression still has a significant effect in the image, by magnifying the image in camera prior to the encode, these images take on a hybrid of pixilation and compression decimation. There is also a slight halation ghosting around the higher contrast edges which get encoded into a pleasant glow.

Read more →
January 28, 2021
Color and the Physiological Response - A Colorist's Exploration
January 28, 2021
Color and the Physiological Response - A Colorist's Exploration
January 28, 2021

Colors, generally speaking, are instinctively associated with emotions. Working as a colorist and having to manipulate color everyday – I feel that most directors and cinematographers intuitively ask for specific colors to enhance specific emotions on special scenes without even realizing it. Here is a little help on how to actually use color in film making to activate – or not – a physical reaction in your audience.

Read more →
January 28, 2021