com.github.chen0040.rl.models

Class QModel

java.lang.Object

com.github.chen0040.rl.models.QModel

public class QModel
extends Object

Author:

xschen 9/27/2015 0027. Q is known as the quality of state-action combination, note that it is different from utility of a state

Constructor Summary

Constructors

Constructor and Description
QModel()
QModel(int stateCount, int actionCount)
QModel(int stateCount, int actionCount, double initialQ)

Method Summary

Modifier and Type	Method and Description
IndexValue	actionWithMaxQAtState(int stateId, Set<Integer> actionsAtState)
IndexValue	actionWithSoftMaxQAtState(int stateId, Set<Integer> actionsAtState, Random random)
Object	clone()
void	copy(QModel rhs)
boolean	equals(Object rhs)
int	getActionCount()
Matrix	getAlpha()
double	getAlpha(int stateId, int actionId)
double	getGamma()
Matrix	getQ()
double	getQ(int stateId, int actionId)
int	getStateCount()
void	setAlpha(double defaultAlpha)
void	setAlpha(Matrix alpha)
void	setGamma(double gamma)
void	setQ(int stateId, int actionId, double Qij)
void	setQ(Matrix q)

Methods inherited from class java.lang.Object

finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

QModel

public QModel(int stateCount,
              int actionCount,
              double initialQ)

QModel

public QModel(int stateCount,
              int actionCount)

QModel

public QModel()

Method Detail

equals

public boolean equals(Object rhs)

Overrides:

equals in class Object

clone

public Object clone()

Overrides:

clone in class Object

copy

public void copy(QModel rhs)

getQ

public Matrix getQ()

getQ

public double getQ(int stateId,
                   int actionId)

setQ

public void setQ(Matrix q)

setQ

public void setQ(int stateId,
                 int actionId,
                 double Qij)

getAlpha

public Matrix getAlpha()

getAlpha

public double getAlpha(int stateId,
                       int actionId)

setAlpha

public void setAlpha(Matrix alpha)

setAlpha

public void setAlpha(double defaultAlpha)

getGamma

public double getGamma()

setGamma

public void setGamma(double gamma)

getStateCount

public int getStateCount()

getActionCount

public int getActionCount()

actionWithMaxQAtState

public IndexValue actionWithMaxQAtState(int stateId,
                                        Set<Integer> actionsAtState)

actionWithSoftMaxQAtState

public IndexValue actionWithSoftMaxQAtState(int stateId,
                                            Set<Integer> actionsAtState,
                                            Random random)