What machine learning algorithm solves this problem?

I want to solve this classification problem. Basically what I have is a sequence of feature vectors $\mathbf{x}_1,\mathbf{x}_2,\dots,\mathbf{x}_N$, and each feature vector is sequential in time. I want to predict the class label $y$ based on the observation of these $N$ feature vectors. The outcome label $y$ can be from a set of two possible classes $y \in \{A,B\}$. So my question is: What machine learning algorithm is best suited for this kind of problem? I know sequential learning like Hidden Markov Model, but they are more suitable for the case where each observation $\mathbf{x}_i$ corresponds to a hidden state $y_i$, versus here in my case only the final class label is needed. There is no hidden states along the time in my problem. So the goal is to predict the class label $y$ based on a sequence of feature vectors $\{\mathbf{x}_i\}_{i=1}^{N}$. Any suggestions?

• Search for "classification algorithms for longitudinal data" or "classification algorithms for time-series data" (depending on the type of your data). You can also search for "longitudinal data analysis". Also, this question seems to fit better in stats.stackexchange.com , since this site is about Theoretical Computer Science. – George Jan 29 '13 at 20:04
• Is time a relevant feature or are you saying that the algorithm is "online"? – Lev Reyzin Jan 29 '13 at 20:14
• What is your training data like? Do you ever get to observe the true label y for any of the examples? The HMM you mentioned is an unsupervised learning algorithm (as in, you never get to see any labels), while the setting you seem to be describing suggests that labels of some sort ought to be available. – Aryeh Jan 29 '13 at 20:21
• @LevReyzin All the feature vectors $x_1, x_2, ..., x_N$ are in time sequence. I want to predict the label $y$ given a sequence of x. – tonga Jan 29 '13 at 22:17
• @Aryeh: I don't have any label information for each observed $\mathbf{x}_i$ at time instance $i$. My goal is to classify the whole sequence to either $y \in A$ or $y \in B$. So I don't know any labeling information of underlying states. Is my problem the same as Hidden Markov Model? – tonga Jan 29 '13 at 22:21