Data Envelopment Analysis (DEA) is a well-known method used to measure the efficiency of decision making units. In this paper, we study the impact of the financial crisis while integrating DEA efficiency measures with Support Vector Machines (SVM). Moreover, to account for the heterogeneity effect in the efficiency measures, the gap statistical method of Tibshirani, et al., (2001) [Tibshirani, R., Walther, G., & Hastie, T. (2001). Estimating the number of clusters in a data set via the gap statistic. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 63(2), 411-423.] is applied in order to achieve the optimal number of cluster. This study uses December quarterly panel data consisting of Farm Credit Agricultural Banks data from 2005 to 2016. We find strong evidence that the efficiency measures were stationary prior to the financial crisis (2005-2006), during the financial crisis (2007-2009) and post financial crisis (2010-2016). The results further show that the integrated DEA-SVM provide a lower performance during 2007-2009. Furthermore, the results show that the Agricultural banking sector was both efficient and stable over the period being analysed.