com.github.chen0040.rl.learning.sarsa

Class SarsaAgent

java.lang.Object

com.github.chen0040.rl.learning.sarsa.SarsaAgent

All Implemented Interfaces:

Serializable

public class SarsaAgent
extends Object
implements Serializable

Created by xschen on 9/27/2015 0027. Implement temporal-difference learning Sarsa, which is an on-policy TD control algorithm

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
SarsaAgent()
SarsaAgent(int stateCount, int actionCount)
SarsaAgent(int stateCount, int actionCount, double alpha, double gamma, double initialQ)
SarsaAgent(SarsaLearner learner)

Method Summary

Modifier and Type	Method and Description
void	copy(SarsaAgent rhs)
void	enableEligibilityTrace(double lambda)
boolean	equals(Object obj)
int	getCurrentAction()
int	getCurrentState()
SarsaLearner	getLearner()
int	getPrevAction()
int	getPrevState()
SarsaAgent	makeCopy()
int	selectAction()
int	selectAction(Set<Integer> actionsAtState)
void	setLearner(SarsaLearner learner)
void	start(int currentState)
void	update(int actionTaken, int newState, double immediateReward)
void	update(int actionTaken, int newState, Set<Integer> actionsAtNewState, double immediateReward)

Methods inherited from class java.lang.Object

clone, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SarsaAgent

public SarsaAgent(int stateCount,
                  int actionCount,
                  double alpha,
                  double gamma,
                  double initialQ)

SarsaAgent

public SarsaAgent(int stateCount,
                  int actionCount)

SarsaAgent

public SarsaAgent(SarsaLearner learner)

SarsaAgent

public SarsaAgent()

Method Detail

getCurrentState

public int getCurrentState()

getCurrentAction

public int getCurrentAction()

getPrevState

public int getPrevState()

getPrevAction

public int getPrevAction()

start

public void start(int currentState)

selectAction

public int selectAction()

selectAction

public int selectAction(Set<Integer> actionsAtState)

update

public void update(int actionTaken,
                   int newState,
                   double immediateReward)

update

public void update(int actionTaken,
                   int newState,
                   Set<Integer> actionsAtNewState,
                   double immediateReward)

getLearner

public SarsaLearner getLearner()

setLearner

public void setLearner(SarsaLearner learner)

enableEligibilityTrace

public void enableEligibilityTrace(double lambda)

makeCopy

public SarsaAgent makeCopy()

copy

public void copy(SarsaAgent rhs)

equals

public boolean equals(Object obj)

Overrides:

equals in class Object