com.github.chen0040.rl.models

Class QModel

java.lang.Object

com.github.chen0040.rl.models.QModel

public class QModel
extends Object

Author:

xschen 9/27/2015 0027. Q is known as the quality of state-action combination, note that it is different from utility of a state

Constructor Summary

Constructors

Constructor and Description
QModel()
QModel(int stateCount, int actionCount)
QModel(int stateCount, int actionCount, double initialQ)

Method Summary

Modifier and Type	Method and Description
IndexValue	actionWithMaxQAtState(int stateId, Set<Integer> actionsAtState)
IndexValue	actionWithSoftMaxQAtState(int stateId, Set<Integer> actionsAtState, Random random)
void	copy(QModel rhs)
boolean	equals(Object rhs)
double	getAlpha(int stateId, int actionId)
double	getQ(int stateId, int actionId)
QModel	makeCopy()
void	setAlpha(double defaultAlpha)
void	setQ(int stateId, int actionId, double Qij)

Methods inherited from class java.lang.Object

clone, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

QModel

public QModel(int stateCount,
              int actionCount,
              double initialQ)

QModel

public QModel(int stateCount,
              int actionCount)

QModel

public QModel()

Method Detail

equals

public boolean equals(Object rhs)

Overrides:

equals in class Object

makeCopy

public QModel makeCopy()

copy

public void copy(QModel rhs)

getQ

public double getQ(int stateId,
                   int actionId)

setQ

public void setQ(int stateId,
                 int actionId,
                 double Qij)

getAlpha

public double getAlpha(int stateId,
                       int actionId)

setAlpha

public void setAlpha(double defaultAlpha)

actionWithMaxQAtState

public IndexValue actionWithMaxQAtState(int stateId,
                                        Set<Integer> actionsAtState)

actionWithSoftMaxQAtState

public IndexValue actionWithSoftMaxQAtState(int stateId,
                                            Set<Integer> actionsAtState,
                                            Random random)