com.github.chen0040.rl.learning.sarsa

Class SarsaLearner

java.lang.Object

com.github.chen0040.rl.learning.sarsa.SarsaLearner

All Implemented Interfaces:

Serializable, Cloneable

Direct Known Subclasses:

SarsaLambdaLearner

public class SarsaLearner
extends Object
implements Serializable, Cloneable

Created by xschen on 9/27/2015 0027. Implement temporal-difference learning Q-Learning, which is an off-policy TD control algorithm Q is known as the quality of state-action combination, note that it is different from utility of a state

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
protected QModel	model

Constructor Summary

Constructors

Constructor and Description
SarsaLearner()
SarsaLearner(int stateCount, int actionCount)
SarsaLearner(int stateCount, int actionCount, double alpha, double gamma, double initialQ)
SarsaLearner(QModel model, ActionSelectionStrategy actionSelectionStrategy)

Method Summary

Modifier and Type	Method and Description
void	copy(SarsaLearner rhs)
boolean	equals(Object obj)
String	getActionSelection()
QModel	getModel()
static void	main(String[] args)
SarsaLearner	makeCopy()
int	selectAction(int stateId)
int	selectAction(int stateId, Set<Integer> actionsAtState)
void	setActionSelection(String conf)
void	setModel(QModel model)
void	update(int stateId, int actionId, int nextStateId, int nextActionId, double immediateReward)

Methods inherited from class java.lang.Object

clone, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

model

protected QModel model

Constructor Detail

SarsaLearner

public SarsaLearner()

SarsaLearner

public SarsaLearner(int stateCount,
                    int actionCount)

SarsaLearner

public SarsaLearner(QModel model,
                    ActionSelectionStrategy actionSelectionStrategy)

SarsaLearner

public SarsaLearner(int stateCount,
                    int actionCount,
                    double alpha,
                    double gamma,
                    double initialQ)

Method Detail

makeCopy

public SarsaLearner makeCopy()

copy

public void copy(SarsaLearner rhs)

equals

public boolean equals(Object obj)

Overrides:

equals in class Object

getModel

public QModel getModel()

setModel

public void setModel(QModel model)

getActionSelection

public String getActionSelection()

setActionSelection

public void setActionSelection(String conf)

main

public static void main(String[] args)

selectAction

public int selectAction(int stateId,
                        Set<Integer> actionsAtState)

selectAction

public int selectAction(int stateId)

update

public void update(int stateId,
                   int actionId,
                   int nextStateId,
                   int nextActionId,
                   double immediateReward)