For dependent Bernoulli random variables, the distribution of a sum of the random variables is obtained as a generalized binomial distribution determined by a two-state Markov chain. Asymptotic distributions of the sum are derived from the central limit theorem and the Edgeworth expansion. A numerical comparison of the exact and asymptotic distributions of the sum is also given. Further a distribution of the sum by the Bayesian approach is derived and its asymptotic distributions are provided. Numerical results are given.