The major trend of smart systems is to work with big data, from a variety of sources, and the knowledge sources of these systems are often expressed in terms of probability. The integration of knowledge bases of intelligent systems in which knowledge is expressed in the form of logical formulas or knowledge frames has been studied and has been widely applied. However, we cannot apply these knowledge integration frameworks for knowledge represented in this form to probabilistic knowledge bases. Therefore, the construction of frameworks for integrating knowledge represented by probability is essential, and it is necessary to invest in research. The theoretical results are applied immediately in building a Vietnamese semantic knowledge base through the integration of knowledge from rich sources on the Internet.