👁 Preview — Study, Practice and Revise are open; mock tests and the rest of the syllabus unlock on subscription. Unlock all · ₹4,999
← Back to Random Processes and Signal Analysis
Study mode

Filtering Random Signals through LTI Systems

Learning objective
Apply linear time-invariant (LTI) system theory to filter random signals

Introduction

In the world of electronics and telecommunication engineering, signals are often not deterministic but random in nature. These random signals arise due to noise, interference, or inherent randomness in the source. Understanding how these signals behave and how to process them is crucial for designing reliable communication systems.

One of the fundamental tools for signal processing is the Linear Time-Invariant (LTI) system. LTI systems are widely used because they are mathematically tractable and model many practical devices like filters, amplifiers, and communication channels.

Filtering random signals through LTI systems is essential to reduce noise, enhance desired signals, and analyze system performance. This section will build from the basics of random signals and LTI systems to the statistical analysis of filtered outputs, equipping you with the knowledge to solve typical ISRO Scientist/Engineer exam problems.

LTI Systems and Random Signals

Before diving into filtering, let's revisit the key concepts of LTI systems and random signals.

Linear Time-Invariant (LTI) Systems

An LTI system is defined by two properties:

  • Linearity: The system's response to a sum of inputs is the sum of the responses to each input individually.
  • Time-Invariance: The system's behavior does not change over time; shifting the input signal in time shifts the output by the same amount.

The output \( y(t) \) of an LTI system with input \( x(t) \) is given by the convolution integral:

Convolution Integral

\[y(t) = \int_{-\infty}^{\infty} x(\tau) h(t - \tau) d\tau\]

Output of LTI system as convolution of input and impulse response

x(t) = Input signal
h(t) = Impulse response of the system

Here, \( h(t) \) is the impulse response of the system, which completely characterizes the system's behavior.

Random Signals

A random signal is a signal whose amplitude varies in an unpredictable manner over time. Unlike deterministic signals, random signals are described statistically.

Key statistical properties include:

  • Mean (or expected value): The average value of the signal over many realizations.
  • Autocorrelation function: Measures similarity between the signal and a time-shifted version of itself, providing insight into signal memory and structure.

Filtering Random Signals through LTI Systems

When a random signal \( x(t) \) passes through an LTI system with impulse response \( h(t) \), the output \( y(t) \) is also a random signal. The system modifies the statistical properties of the input.

x(t) LTI System Impulse Response h(t) y(t)

The output is given by:

Output Signal

y(t) = x(t) * h(t)

Convolution of input random signal with system impulse response

x(t) = Input random signal
h(t) = Impulse response
y(t) = Output random signal

Because \( x(t) \) is random, we analyze the output statistically, focusing on mean and autocorrelation functions.

Effect on Mean

The mean of the output signal \( \mu_y(t) \) is the convolution of the input mean \( \mu_x(t) \) with the impulse response:

Output Mean

\[\mu_y(t) = \mu_x(t) * h(t) = \mu_x \int_{-\infty}^{\infty} h(\tau) d\tau\]

Mean of output random signal after LTI filtering

\(\mu_x\) = Mean of input signal
h(t) = Impulse response

If the input is zero-mean, the output mean is zero unless the system adds a bias.

Effect on Autocorrelation

The autocorrelation function \( R_x(\tau) \) of the input signal describes how the signal correlates with itself at different time lags \( \tau \). The output autocorrelation \( R_y(\tau) \) is related to the input autocorrelation and the system impulse response by:

Output Autocorrelation

\[R_y(\tau) = R_x(\tau) * h(\tau) * h(-\tau)\]

Output autocorrelation as convolution of input autocorrelation and impulse response

\(R_x(\tau)\) = Input autocorrelation
\(h(\tau)\) = Impulse response

This convolution reflects how the system shapes the correlation properties of the input signal.

Autocorrelation and Power Spectral Density

To understand random signals in the frequency domain, we use the Power Spectral Density (PSD), which is the Fourier transform of the autocorrelation function.

Autocorrelation Function

The autocorrelation function \( R_x(\tau) \) of a stationary random signal \( x(t) \) is defined as:

Autocorrelation Function

\[R_x(\tau) = E[x(t) x(t + \tau)]\]

Expected value of product of signal with time-shifted version

E = Expectation operator
x(t) = Random signal

This function measures how the signal values at two time instants separated by \( \tau \) are related.

Power Spectral Density (PSD)

The PSD \( S_x(f) \) shows how the power of a signal is distributed over frequency \( f \). It is the Fourier transform of the autocorrelation function:

Power Spectral Density

\[S_x(f) = \int_{-\infty}^{\infty} R_x(\tau) e^{-j 2 \pi f \tau} d\tau\]

Fourier transform of autocorrelation function

\(R_x(\tau)\) = Autocorrelation function
f = Frequency

PSD is especially useful to analyze how filtering affects the frequency content of random signals.

graph TD    A[Input Random Signal x(t)]    B[Input Autocorrelation R_x(τ)]    C[Input PSD S_x(f)]    D[LTI System with h(t), H(f)]    E[Output Autocorrelation R_y(τ)]    F[Output PSD S_y(f)]    A --> B    B --> C    C --> D    D --> F    F --> E

Flowchart: The input signal's autocorrelation and PSD are transformed by the LTI system to produce the output autocorrelation and PSD.

PSD Transformation through LTI Systems

The output PSD \( S_y(f) \) is related to the input PSD \( S_x(f) \) and the system's frequency response \( H(f) \) by:

Output Power Spectral Density

\[S_y(f) = |H(f)|^2 S_x(f)\]

Output PSD equals input PSD multiplied by magnitude squared of system frequency response

\(S_x(f)\) = Input PSD
H(f) = System frequency response

This formula is fundamental and allows quick calculation of output spectral characteristics without performing time-domain convolution.

Filtering White Noise through LTI Systems

White noise is a special random signal with equal power at all frequencies, making it a common model for noise in communication systems.

Properties of White Noise

  • Zero mean: \( \mu_x = 0 \)
  • Autocorrelation: \( R_x(\tau) = \frac{N_0}{2} \delta(\tau) \), where \( \delta(\tau) \) is the Dirac delta function
  • PSD: Flat spectrum \( S_x(f) = \frac{N_0}{2} \) constant for all frequencies

Here, \( N_0 \) is the noise power spectral density constant.

Comparison of White Noise Input and Filtered Output PSD
Characteristic White Noise Input Filtered Output
Mean 0 0
Autocorrelation \( R_x(\tau) \) \( \frac{N_0}{2} \delta(\tau) \) \( \frac{N_0}{2} (h * h^-)(\tau) \)
PSD \( S_x(f) \) \( \frac{N_0}{2} \) (constant) \( \frac{N_0}{2} |H(f)|^2 \)

Filtering white noise shapes its PSD according to the system's frequency response, effectively "coloring" the noise.

Formula Bank

Formula Bank

Output Mean
\[ \mu_y(t) = \mu_x(t) * h(t) = \mu_x \int_{-\infty}^{\infty} h(\tau) d\tau \]
where: \(\mu_x\) = mean of input signal, \(h(t)\) = impulse response
Output Autocorrelation
\[ R_y(\tau) = R_x(\tau) * h(\tau) * h(-\tau) \]
where: \(R_x(\tau)\) = input autocorrelation, \(h(\tau)\) = impulse response
Output Power Spectral Density
\[ S_y(f) = |H(f)|^2 S_x(f) \]
where: \(S_x(f)\) = input PSD, \(H(f)\) = system frequency response
White Noise PSD
\[ S_x(f) = \frac{N_0}{2} \]
where: \(N_0\) = noise power spectral density constant
Convolution Integral
\[ y(t) = \int_{-\infty}^{\infty} x(\tau) h(t - \tau) d\tau \]
where: \(x(t)\) = input signal, \(h(t)\) = impulse response

Worked Examples

Example 1: Output Autocorrelation of Filtered Random Signal Easy
Given a random signal \( x(t) \) with autocorrelation \( R_x(\tau) = e^{-|\tau|} \), and an LTI system with impulse response \( h(t) = e^{-t} u(t) \) where \( u(t) \) is the unit step function, find the autocorrelation \( R_y(\tau) \) of the output signal \( y(t) \).

Step 1: Identify the given functions:

  • Input autocorrelation: \( R_x(\tau) = e^{-|\tau|} \)
  • Impulse response: \( h(t) = e^{-t} u(t) \)

Step 2: Recall the output autocorrelation formula:

\[ R_y(\tau) = R_x(\tau) * h(\tau) * h(-\tau) \]

Step 3: Compute \( h(-\tau) \):

\[ h(-\tau) = e^{\tau} u(-\tau) \]

Step 4: Perform the convolution \( h(\tau) * h(-\tau) \):

Since \( h(t) \) is causal, the convolution results in a function \( g(\tau) \) which can be found by integration (details omitted for brevity).

Step 5: Convolve \( R_x(\tau) \) with \( g(\tau) \) to get \( R_y(\tau) \).

Answer: The output autocorrelation \( R_y(\tau) \) is the convolution of \( e^{-|\tau|} \) with \( g(\tau) \), reflecting the smoothing effect of the system.

Example 2: Power Spectral Density of Output Signal Medium
The input random signal has PSD \( S_x(f) = \frac{1}{1 + f^2} \). The LTI system has frequency response \( H(f) = \frac{1}{1 + j2\pi f} \). Find the output PSD \( S_y(f) \).

Step 1: Calculate the magnitude squared of \( H(f) \):

\[ |H(f)|^2 = \frac{1}{1 + (2\pi f)^2} \]

Step 2: Use the formula for output PSD:

\[ S_y(f) = |H(f)|^2 S_x(f) = \frac{1}{1 + (2\pi f)^2} \times \frac{1}{1 + f^2} \]

Answer: The output PSD is \( S_y(f) = \frac{1}{(1 + (2\pi f)^2)(1 + f^2)} \).

Example 3: Filtering White Noise through an RC Low-Pass Filter Medium
White noise with PSD \( S_x(f) = \frac{N_0}{2} \) passes through an RC low-pass filter with transfer function \( H(f) = \frac{1}{1 + j2\pi f RC} \). Find the output PSD and describe the effect on noise.

Step 1: Calculate magnitude squared of \( H(f) \):

\[ |H(f)|^2 = \frac{1}{1 + (2\pi f RC)^2} \]

Step 2: Use the output PSD formula:

\[ S_y(f) = |H(f)|^2 S_x(f) = \frac{N_0}{2} \times \frac{1}{1 + (2\pi f RC)^2} \]

Step 3: Interpretation:

The filter attenuates high-frequency noise components, reducing noise power at frequencies above the cutoff \( \frac{1}{2\pi RC} \).

Answer: The output noise PSD is shaped by the RC filter, effectively low-pass filtering the white noise.

Example 4: Mean and Variance of Output Signal Hard
A random signal \( x(t) \) has mean \( \mu_x = 2 \) and autocorrelation \( R_x(\tau) = 4 e^{-|\tau|} \). It passes through an LTI system with impulse response \( h(t) = e^{-t} u(t) \). Find the mean and variance of the output signal \( y(t) \).

Step 1: Calculate output mean using:

\[ \mu_y = \mu_x \int_{-\infty}^{\infty} h(\tau) d\tau \]

Since \( h(t) = e^{-t} u(t) \),

\[ \int_0^\infty e^{-\tau} d\tau = 1 \]

Thus, \( \mu_y = 2 \times 1 = 2 \).

Step 2: Calculate output autocorrelation:

\[ R_y(\tau) = R_x(\tau) * h(\tau) * h(-\tau) \]

Convolution of exponentials yields \( R_y(0) \) (variance) as:

\[ \sigma_y^2 = R_y(0) - \mu_y^2 \]

After performing convolution (details omitted), \( R_y(0) = 4 \times 0.5 = 2 \).

Step 3: Compute variance:

\[ \sigma_y^2 = 2 - (2)^2 = 2 - 4 = -2 \]

Note: Negative variance is impossible, indicating a misinterpretation. Remember variance is \( \sigma_y^2 = R_y(0) - \mu_y^2 \) only if \( R_y(0) \) is the second moment.

Since \( R_x(0) = E[x^2(t)] = \sigma_x^2 + \mu_x^2 = 4 + 4 = 8 \), the output second moment is:

\[ R_y(0) = 8 \times \int h(\tau) d\tau \times \int h(-\tau) d\tau = 8 \times 1 \times 1 = 8 \]

Therefore, variance is:

\[ \sigma_y^2 = 8 - (2)^2 = 8 - 4 = 4 \]

Answer: Output mean \( \mu_y = 2 \), variance \( \sigma_y^2 = 4 \).

Example 5: ISRO Scientist Exam Style Question on Random Signal Filtering Hard
A zero-mean stationary random process \( x(t) \) has autocorrelation \( R_x(\tau) = e^{-|\tau|} \). It passes through an LTI system with impulse response \( h(t) = \delta(t) - 0.5 \delta(t - 1) \). Find the output PSD \( S_y(f) \).

Step 1: Find the system frequency response \( H(f) \):

\[ H(f) = 1 - 0.5 e^{-j 2 \pi f} \]

Step 2: Calculate magnitude squared:

\[ |H(f)|^2 = \left(1 - 0.5 e^{-j 2 \pi f}\right) \left(1 - 0.5 e^{j 2 \pi f}\right) = 1 - 0.5 e^{j 2 \pi f} - 0.5 e^{-j 2 \pi f} + 0.25 \]

Using Euler's formula:

\[ |H(f)|^2 = 1 + 0.25 - 0.5 \times 2 \cos(2 \pi f) = 1.25 - \cos(2 \pi f) \]

Step 3: Find input PSD \( S_x(f) \), Fourier transform of \( R_x(\tau) = e^{-|\tau|} \):

\[ S_x(f) = \int_{-\infty}^\infty e^{-|\tau|} e^{-j 2 \pi f \tau} d\tau = \frac{2}{1 + (2 \pi f)^2} \]

Step 4: Calculate output PSD:

\[ S_y(f) = |H(f)|^2 S_x(f) = \left(1.25 - \cos(2 \pi f)\right) \times \frac{2}{1 + (2 \pi f)^2} \]

Answer: The output PSD is \( S_y(f) = \frac{2 (1.25 - \cos(2 \pi f))}{1 + (2 \pi f)^2} \).

Tips & Tricks

Tip: Remember that the output PSD is always the input PSD multiplied by the squared magnitude of the system's frequency response.

When to use: Quickly determine output spectral characteristics without performing convolution.

Tip: Use properties of convolution and symmetry in autocorrelation functions to simplify calculations.

When to use: While finding output autocorrelation from input autocorrelation and impulse response.

Tip: For white noise input, the autocorrelation is an impulse function; use this to simplify filtering calculations.

When to use: When dealing with white noise filtering problems.

Tip: In exam conditions, focus on formula application and avoid lengthy integral computations by using known transforms and properties.

When to use: During time-constrained entrance exams like ISRO Scientist/Engineer.

Tip: Memorize key relationships between autocorrelation and PSD to quickly switch between time and frequency domain analyses.

When to use: When solving problems involving random signal statistics.

Common Mistakes to Avoid

❌ Confusing the convolution of signals with multiplication of their Fourier transforms.
✓ Remember convolution in time domain corresponds to multiplication in frequency domain, and vice versa.
Why: Students often mix domain operations leading to incorrect PSD or autocorrelation calculations.
❌ Ignoring the effect of system phase response when calculating output PSD.
✓ Output PSD depends only on magnitude squared of frequency response; phase does not affect PSD.
Why: Phase affects time-domain signal shape but not power spectral density.
❌ Assuming white noise has zero autocorrelation everywhere except at zero lag without considering scaling constants.
✓ Include the noise power spectral density constant \( N_0/2 \) in calculations.
Why: Neglecting constants leads to incorrect power estimates.
❌ Using mean values of signals incorrectly when signals are zero-mean random processes.
✓ Check if the input signal mean is zero; if so, output mean is zero unless system adds bias.
Why: Incorrect mean assumptions affect statistical property calculations.
❌ Mixing up input and output variables in formulas for autocorrelation and PSD.
✓ Carefully track which function corresponds to input and which to output in formulas.
Why: Mislabeling leads to wrong final answers.
Curated videos per subtopic
Top YouTube explainers, AI-ranked for your exam and language. Unlocks with subscription.
Unlock

Try Practice next.

Progress tracking is paywalled — subscribe to mark subtopics as understood and save your streak.

Go to practice →
Ask a doubt
Filtering Random Signals through LTI Systems · 10 free messages
Ask me anything about this subtopic. You have 10 free messages this session — chat history isn't saved in preview.