Optimization Techniques
UNIT-I: Linear Programming
Central Problem of Linear Programming, various definitions, statements of basic theorem and their properties, simplex methods, primal and dual simplex method, transport problem, tic-tac problem, and its solution. Assignment problem and its solution. Graphical Method Formulation, Linear Programming Problem.
UNIT-II: Queuing Theory
Characteristics of queuing system, classification of Queuing Model, Single Channel Queuing Theory, generalization of steady state M/M/1 queuing models (Model-I, Model-II).
UNIT-III: Replacement Theory
Replacement of items that deteriorate, replacement of items that fail. Group replacement and individual replacement.
UNIT-IV: Inventory Theory
Cost involved in inventory problem - single item deterministic model, economic lot size model without shortage and with shortage having production rate infinite and finite.
UNIT-V: Job Sequencing
Introduction, solution of sequencing problem, Johnson’s algorithm for n jobs through 2 machines.

UNIT-I: Linear Programming

1.1 Central Problem of Linear Programming

Linear Programming is a mathematical approach used to determine the best outcome (such as maximum profit or minimum cost) in a mathematical model. The central problem of linear programming involves optimizing a linear objective function, subject to a set of linear constraints.

Definitions and Basic Terms:

Theorems and Properties:

1.2 Simplex Method

The Simplex Method is an algorithm for solving linear programming problems. It iterates through the vertices of the feasible region to find the optimal solution.

Steps in the Simplex Method:

    # Simplex Method (Example)
    1. Start with an initial feasible solution.
    2. Evaluate the objective function (Z).
    3. Select the entering variable based on the most negative coefficient in the objective function.
    4. Identify the leaving variable using the ratio test.
    5. Pivot and update the solution until optimality is reached.
                

1.3 Primal and Dual Simplex Method

The Primal and Dual Simplex Methods are variations of the Simplex Method used to solve linear programming problems.

Primal Simplex Method:

Used when the initial solution is feasible. The method iterates through the feasible region to find the optimal solution.

Dual Simplex Method:

Used when the initial solution is not feasible, but the optimality of the objective function is satisfied. The method makes the solution feasible while optimizing the objective function.

1.4 Transport Problem

The transportation problem involves finding the most efficient way to transport goods from suppliers to consumers while minimizing the transportation cost.

Key Components:

Example:

We are given multiple suppliers and demand points. The goal is to minimize the total cost of transporting goods.

    # Example of Transport Problem Setup:
    Supply: [100, 150, 200]
    Demand: [120, 130, 200]
    Cost Matrix:
         D1  D2  D3
    S1  [4,  6,  8]
    S2  [2,  5,  7]
    S3  [3,  4,  6]
                

1.5 Tic-Tac Problem and Its Solution

The Tic-Tac-Toe problem involves finding an optimal way to fill the Tic-Tac-Toe grid under specific constraints. It is a type of combinatorial optimization problem.

    # Example Tic-Tac-Toe Problem Setup:
    Define each grid cell as a variable.
    Constraints: Ensure one player wins, or it results in a draw.
    Use Linear Programming or optimization methods to solve.
                

1.6 Assignment Problem

The Assignment Problem is a special type of optimization problem where tasks are assigned to agents to minimize the total cost or maximize the total efficiency.

Example:

Given 4 workers and 4 tasks, we need to assign each worker to one task such that the total cost is minimized.

    # Example Assignment Problem:
    Workers: W1, W2, W3, W4
    Tasks: T1, T2, T3, T4
    Cost Matrix:
         T1  T2  T3  T4
    W1  [9,  2,  5,  8]
    W2  [4,  6,  7,  3]
    W3  [3,  5,  4,  2]
    W4  [7,  6,  5,  9]
                

1.7 Graphical Method Formulation

The graphical method is a technique used to solve linear programming problems with two variables. The solution is found at the vertex of the feasible region formed by the constraints.

Steps:

    # Example of Graphical Method:
    Maximize: Z = 3x + 2y
    Subject to:
        x + y <= 4
        x >= 0
        y >= 0
    
    # Plot the constraints, identify the feasible region, and find the optimal solution.
                

1.8 Linear Programming Problem Formulation

A Linear Programming Problem (LPP) is formulated by defining the objective function and the constraints that need to be optimized.

General Formulation:

    # General Linear Programming Problem Formulation:
    Maximize Z = c1*x1 + c2*x2 + ... + cn*xn
    Subject to:
        a11*x1 + a12*x2 + ... + a1n*xn <= b1
        a21*x1 + a22*x2 + ... + a2n*xn <= b2
        ...
        xn >= 0 for all x.
                

UNIT-II: Queuing Theory

2.1 Characteristics of Queuing System

Queuing theory is the mathematical study of waiting lines or queues. It is used to model the process of arriving customers, waiting for service, and receiving service in various systems.

Key Characteristics:

2.2 Classification of Queuing Model

Queuing models are classified based on various factors, such as the arrival process, service mechanism, and number of servers. These classifications help to analyze the performance of the system.

Common Classifications:

2.3 Single Channel Queuing Theory

In a single-channel queuing system, there is only one server available to serve all the customers. This is the simplest queuing model and is used in situations where only one service is available at a time.

Key Features:

Example:

Consider a scenario where customers arrive at a bank at a rate of 10 per hour, and the server can serve customers at a rate of 12 per hour. The system is analyzed using the single-channel queuing theory.

    # Example of Single Channel Queuing System (M/M/1)
    Arrival Rate (λ) = 10 customers/hour
    Service Rate (μ) = 12 customers/hour
    Utilization (ρ) = λ / μ = 10 / 12 = 0.83
    
    The system is stable because ρ < 1.
                

2.4 Generalization of Steady State M/M/1 Queuing Models

The M/M/1 model is one of the most commonly used queuing models. It assumes that both the arrival and service processes follow an exponential distribution, and there is a single server. This model can be generalized to handle different cases based on variations in the system.

Model-I: M/M/1 Queuing Model

The basic M/M/1 model assumes:

Steady-State Equations for M/M/1:

    # Example of M/M/1 System:
    Arrival Rate (λ) = 5 customers/hour
    Service Rate (μ) = 8 customers/hour
    
    Utilization (ρ) = λ / μ = 5 / 8 = 0.625
    Average number of customers (L) = 0.625 / (1 - 0.625) = 1.67
    Average time in the system (W) = 1 / (8 - 5) = 0.33 hours
                

Model-II: Generalized M/M/1 Queuing Model

In the generalized M/M/1 model, some variations in assumptions allow for more complex systems, such as considering different arrival and service rate distributions or adding server priority rules.

Example of Generalization:

Consider a queuing system with multiple servers (M/M/c) or systems with finite capacity (M/M/1/K), where K is the maximum number of customers the system can hold.

    # Example of M/M/c (Multiple Server) System:
    Arrival Rate (λ) = 10 customers/hour
    Service Rate (μ) = 12 customers/hour per server
    Number of servers (c) = 2
    
    Utilization (ρ) = λ / (c * μ) = 10 / (2 * 12) = 0.4167
                

UNIT-III: Replacement Theory

3.1 Replacement of Item that Deteriorates

Replacement theory deals with replacing items that either deteriorate or fail over time. The key focus is on replacing items before they fail to minimize maintenance costs or replacing items as soon as they deteriorate to prevent inefficiencies.

Key Concepts:

Example:

Consider a machine that has an initial cost of ₹10,000 and deteriorates at a rate that increases maintenance costs over time. The decision to replace it would depend on comparing the maintenance costs over time to the cost of replacing the machine at various intervals.

    # Example of Replacement Problem (Deteriorating Item)
    Initial Cost of Item = ₹10,000
    Maintenance Cost per Year = ₹2,000
    Replacement Cost = ₹15,000
    
    To decide whether to replace, compare the total maintenance cost over time to the cost of replacing the item after a few years.
                

3.2 Replacement of Items that Fail

This type of replacement is concerned with replacing items that have failed completely and are no longer useful. The failure could be due to mechanical breakdowns or any other form of failure, and replacement is necessary to ensure continuity of operations.

Key Concepts:

Example:

Consider a machine that breaks down randomly, and the maintenance costs increase with the age of the machine. The company may decide to replace the machine when the expected cost of maintaining it exceeds the cost of replacing it.

    # Example of Replacement Problem (Failed Item)
    Initial Cost of Machine = ₹15,000
    Maintenance Cost after Failure = ₹5,000
    Expected Cost of Failure (per year) = ₹10,000
    
    To replace or repair, compare the expected maintenance cost with the cost of replacement.
                

3.3 Group Replacement

Group replacement occurs when a group of items is replaced simultaneously, typically due to the fact that the cost of replacing items individually becomes higher over time.

Key Features:

Example:

Suppose a company operates ten identical machines that deteriorate at the same rate. The company may decide to replace all machines after a certain number of years to minimize downtime and maintenance costs.

    # Example of Group Replacement
    Initial Cost of Each Machine = ₹10,000
    Maintenance Cost per Year = ₹2,000
    Number of Machines = 10
    
    Group Replacement Plan: Replace all machines after 5 years if the combined maintenance cost exceeds the cost of replacement.
                

3.4 Individual Replacement

Individual replacement refers to replacing items one at a time, as each item either deteriorates or fails. This method is useful when the items do not have similar lifespans or deterioration rates.

Key Features:

Example:

In a factory with multiple machines, individual replacement may involve replacing each machine as it reaches the end of its useful life, rather than replacing all machines at once.

    # Example of Individual Replacement
    Initial Cost of Machine = ₹12,000
    Maintenance Cost per Year = ₹3,000
    
    Replace each machine individually when maintenance costs exceed ₹5,000 per year, depending on their individual wear and tear.
                

UNIT-IV: Inventory Theory

4.1 Cost Involved in Inventory Problems

Inventory theory deals with determining the optimal quantity and timing of inventory orders to minimize costs while meeting demand. There are various types of costs involved in inventory management:

    Total Inventory Cost = Ordering Cost + Holding Cost + Shortage Cost + Purchase Cost
                

4.2 Single Item Deterministic Model

This model assumes that demand for a single item is known and constant. The objective is to minimize total inventory costs by choosing the optimal order quantity.

    EOQ Formula: 
    Q = √(2DS / H)
    Where:
    D = Demand per year
    S = Ordering cost per order
    H = Holding cost per unit per year
                

4.3 Economic Lot Size Model Without Shortage

This model finds the optimal lot size when shortages are not allowed. The inventory level never drops to zero.

Assumptions:

    EOQ = √(2DS / H)
    Total Cost = (D/Q × S) + (Q/2 × H)
                

4.4 Economic Lot Size Model With Shortage

This model allows for temporary shortages, where unmet demand is backlogged and fulfilled later. It balances holding and shortage costs.

    EOQ with Shortage:
    Q = √(2DS / H(1 - (S / (S + B))))
    Where:
    B = Shortage cost per unit per year
                

4.5 With Production Rate (Infinite and Finite)

When items are produced instead of purchased, production rate is considered:

Infinite Production Rate (Instant Replenishment)

Finite Production Rate (Gradual Replenishment)

    EOQ for Finite Production Rate:
    Q = √(2DS / H × (1 - D/P))
    Where:
    P = Production rate per year
    D = Demand rate per year
    S = Setup/ordering cost
    H = Holding cost per unit per year
                

UNIT-V: Job Sequencing

5.1 Introduction

Job sequencing is the process of determining the order in which a series of jobs should be processed through one or more machines to minimize total elapsed time or idle time.

This is commonly used in manufacturing and operations to increase efficiency and reduce delays.

5.2 Sequencing Problem

The basic sequencing problem involves finding the best sequence of jobs processed through machines so that:

5.3 Johnson's Algorithm for n Jobs through 2 Machines

Johnson’s Rule is an efficient method used to minimize the total time required to process a set of jobs on two machines.

Assumptions:

Steps of Johnson's Algorithm:

  1. List the processing times of all jobs on both machines (A and B).
  2. Find the smallest processing time among all jobs.
  3. If the smallest time is on Machine A, place the job as early as possible in the sequence.
  4. If the smallest time is on Machine B, place the job as late as possible in the sequence.
  5. Remove the job from the list and repeat the process until all jobs are scheduled.
    Example:
    Jobs: J1, J2, J3
    Machine A: 3, 8, 5
    Machine B: 6, 4, 7
    
    Step 1: Smallest time = 3 (J1 on Machine A) → Schedule J1 first
    Step 2: Remaining: J2, J3
    Smallest = 4 (J2 on Machine B) → Schedule J2 last
    Step 3: Remaining: J3 → Place in the middle
    
    Final Sequence: J1 → J3 → J2