Health, Safety, Environment and Ergonomie (HSEE) are important factors in any organization. An organization always have to assess its compliance in these factors to the required benchmarks and take proactive actions to improve them if required. In this paper, we propose a Fuzzy Cognitive Map-Bayesian network (BN) model in order to assist organizations in doing this process. Fuzzy Cognitive Map (FCM) method is used for constructing graphical model of BN to ascertain the relationships between the inputs and the impact which they will have on the quantified HSEE. Noisy-OR method and EM are used to ascertain the conditional probability between the inputs and quantifying the HSEE value. Using this, we find out the most influential input factor on HSEE quantification which can then be managed for improving an organization's compliance to HSEE. Leveraging the power of Bayesian network in modeling HSEE and augmenting it with FCM is the main contribution of this research work which opens this line of research.