Skip to content

chore: Game Theory algorithms are added #11864

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 17 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Empty file added game_theory/__init__.py
Empty file.
30 changes: 30 additions & 0 deletions game_theory/best_response_dynamics.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
import numpy as np


def best_response_dynamics(payoff_matrix_a, payoff_matrix_b, iterations=10):

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: best_response_dynamics. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/best_response_dynamics.py, please provide doctest for the function best_response_dynamics

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Please provide type hint for the parameter: iterations

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: best_response_dynamics. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/best_response_dynamics.py, please provide doctest for the function best_response_dynamics

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Please provide type hint for the parameter: iterations

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: best_response_dynamics. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/best_response_dynamics.py, please provide doctest for the function best_response_dynamics

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Please provide type hint for the parameter: iterations

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: best_response_dynamics. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/best_response_dynamics.py, please provide doctest for the function best_response_dynamics

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Please provide type hint for the parameter: iterations

n = payoff_matrix_a.shape[0]
m = payoff_matrix_a.shape[1]

# Initialize strategies
strategy_a = np.ones(n) / n
strategy_b = np.ones(m) / m

for _ in range(iterations):
# Update strategy A
response_a = np.argmax(payoff_matrix_a @ strategy_b)
strategy_a = np.zeros(n)
strategy_a[response_a] = 1

# Update strategy B
response_b = np.argmax(payoff_matrix_b.T @ strategy_a)
strategy_b = np.zeros(m)
strategy_b[response_b] = 1

return strategy_a, strategy_b


# Example usage
payoff_a = np.array([[3, 0], [5, 1]])
payoff_b = np.array([[2, 4], [0, 2]])
strategies = best_response_dynamics(payoff_a, payoff_b)
print("Final strategies:", strategies)
36 changes: 36 additions & 0 deletions game_theory/fictitious_play.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,36 @@
import numpy as np


def fictitious_play(payoff_matrix_a, payoff_matrix_b, iterations=100):

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: fictitious_play. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/fictitious_play.py, please provide doctest for the function fictitious_play

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Please provide type hint for the parameter: iterations

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: fictitious_play. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/fictitious_play.py, please provide doctest for the function fictitious_play

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Please provide type hint for the parameter: iterations

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: fictitious_play. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/fictitious_play.py, please provide doctest for the function fictitious_play

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Please provide type hint for the parameter: iterations

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: fictitious_play. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/fictitious_play.py, please provide doctest for the function fictitious_play

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Please provide type hint for the parameter: iterations

n = payoff_matrix_a.shape[0]
m = payoff_matrix_a.shape[1]

# Initialize counts and strategies
counts_a = np.zeros(n)
counts_b = np.zeros(m)
strategy_a = np.ones(n) / n
strategy_b = np.ones(m) / m

for _ in range(iterations):
# Update counts
counts_a += strategy_a
counts_b += strategy_b

# Calculate best responses
best_response_a = np.argmax(payoff_matrix_a @ strategy_b)
best_response_b = np.argmax(payoff_matrix_b.T @ strategy_a)

# Update strategies
strategy_a = np.zeros(n)
strategy_a[best_response_a] = 1
strategy_b = np.zeros(m)
strategy_b[best_response_b] = 1

return strategy_a, strategy_b


# Example usage
payoff_a = np.array([[3, 0], [5, 1]])
payoff_b = np.array([[2, 4], [0, 2]])
strategies = fictitious_play(payoff_a, payoff_b)
print("Fictitious Play strategies:", strategies)
29 changes: 29 additions & 0 deletions game_theory/minimax_algorithm.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
def minimax(depth, node_index, is_maximizing_player, values, alpha, beta):

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: minimax. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/minimax_algorithm.py, please provide doctest for the function minimax

Please provide type hint for the parameter: depth

Please provide type hint for the parameter: node_index

Please provide type hint for the parameter: is_maximizing_player

Please provide type hint for the parameter: values

Please provide type hint for the parameter: alpha

Please provide type hint for the parameter: beta

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: minimax. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/minimax_algorithm.py, please provide doctest for the function minimax

Please provide type hint for the parameter: depth

Please provide type hint for the parameter: node_index

Please provide type hint for the parameter: is_maximizing_player

Please provide type hint for the parameter: values

Please provide type hint for the parameter: alpha

Please provide type hint for the parameter: beta

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: minimax. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/minimax_algorithm.py, please provide doctest for the function minimax

Please provide type hint for the parameter: depth

Please provide type hint for the parameter: node_index

Please provide type hint for the parameter: is_maximizing_player

Please provide type hint for the parameter: values

Please provide type hint for the parameter: alpha

Please provide type hint for the parameter: beta

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: minimax. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/minimax_algorithm.py, please provide doctest for the function minimax

Please provide type hint for the parameter: depth

Please provide type hint for the parameter: node_index

Please provide type hint for the parameter: is_maximizing_player

Please provide type hint for the parameter: values

Please provide type hint for the parameter: alpha

Please provide type hint for the parameter: beta

if depth == 0:
return values[node_index]

if is_maximizing_player:
best_value = float("-inf")
for i in range(2): # Two children (0 and 1)
value = minimax(depth - 1, node_index * 2 + i, False, values, alpha, beta)
best_value = max(best_value, value)
alpha = max(alpha, best_value)
if beta <= alpha:
break # Beta cut-off
return best_value
else:
best_value = float("inf")
for i in range(2): # Two children (0 and 1)
value = minimax(depth - 1, node_index * 2 + i, True, values, alpha, beta)
best_value = min(best_value, value)
beta = min(beta, best_value)
if beta <= alpha:
break # Alpha cut-off
return best_value


# Example usage
values = [3, 5, 2, 9, 0, 1, 8, 6] # Leaf node values
depth = 3 # Depth of the game tree
result = minimax(depth, 0, True, values, float("-inf"), float("inf"))
print("The optimal value is:", result)
32 changes: 32 additions & 0 deletions game_theory/nash_equlibrium.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
import numpy as np
from scipy.optimize import linprog


def find_nash_equilibrium(payoff_matrix_a, payoff_matrix_b):

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: find_nash_equilibrium. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/nash_equlibrium.py, please provide doctest for the function find_nash_equilibrium

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: find_nash_equilibrium. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/nash_equlibrium.py, please provide doctest for the function find_nash_equilibrium

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: find_nash_equilibrium. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/nash_equlibrium.py, please provide doctest for the function find_nash_equilibrium

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: find_nash_equilibrium. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/nash_equlibrium.py, please provide doctest for the function find_nash_equilibrium

Please provide type hint for the parameter: payoff_matrix_a

Please provide type hint for the parameter: payoff_matrix_b

n = payoff_matrix_a.shape[0]
m = payoff_matrix_a.shape[1]

# Solve for player A
c = [-1] * n # Objective: maximize A's payoff
a_ub = -payoff_matrix_a # A's constraints
b_ub = [-1] * m

result_a = linprog(c, A_ub=a_ub, b_ub=b_ub, bounds=(0, None))
p_a = result_a.x

# Solve for player B
c = [-1] * m # Objective: maximize B's payoff
a_ub = -payoff_matrix_b.T # B's constraints
b_ub = [-1] * n

result_b = linprog(c, A_ub=a_ub, b_ub=b_ub, bounds=(0, None))
p_b = result_b.x

return p_a, p_b


# Example usage
payoff_a = np.array([[3, 0], [5, 1]])
payoff_b = np.array([[2, 4], [0, 2]])
equilibrium = find_nash_equilibrium(payoff_a, payoff_b)
print("Nash Equilibrium strategies:", equilibrium)
34 changes: 34 additions & 0 deletions game_theory/shapley_value.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,34 @@
import numpy as np


def shapley_value(payoff_matrix):

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: shapley_value. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/shapley_value.py, please provide doctest for the function shapley_value

Please provide type hint for the parameter: payoff_matrix

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: shapley_value. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/shapley_value.py, please provide doctest for the function shapley_value

Please provide type hint for the parameter: payoff_matrix

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: shapley_value. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/shapley_value.py, please provide doctest for the function shapley_value

Please provide type hint for the parameter: payoff_matrix

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please provide return type hint for the function: shapley_value. If the function does not return a value, please provide the type hint as: def function() -> None:

As there is no test file in this pull request nor any test function or class in the file game_theory/shapley_value.py, please provide doctest for the function shapley_value

Please provide type hint for the parameter: payoff_matrix

n = payoff_matrix.shape[1] # Number of players
shapley_values = np.zeros(n) # Initialize Shapley values

# Iterate over each player
for i in range(n):
# Iterate over all subsets of players (from 0 to 2^n - 1)
for s in range(1 << n): # All subsets of players
if (s & (1 << i)) == 0: # If player i is not in subset S
continue

# Calculate the value of the subset S without player i
s_without_i = s & ~(1 << i) # Remove player i from the subset
marginal_contribution = payoff_matrix[s][i] - (
payoff_matrix[s_without_i][i] if s_without_i else 0
)

# Count the size of the subset S
size_of_s = bin(s).count("1") # Number of players in subset S
shapley_values[i] += marginal_contribution / (
size_of_s * (n - size_of_s)
) # Normalize by size of S

return shapley_values


# Example usage
# Payoff matrix with payoffs for 4 coalitions: {}, {1}, {2}, {1, 2}
payoff_matrix = np.array([[0, 0], [1, 0], [0, 2], [3, 4]])
shapley_vals = shapley_value(payoff_matrix)
print("Shapley Values:", shapley_vals)