up


Orbital Optimization Method: Ver. 1.0
The original has been published in Phys. Rev. B 67, 155108 (2003).

Taisuke Ozaki, ISSP, the Univ. of Tokyo
Abstract

A simple and practical method for variationally optimizing numerical atomic orbitals used in density functional calculations is presented based on the force theorem. The derived equation provides the same procedure for the optimization of atomic orbitals as that for the geometry optimization. The optimized orbitals well reproduce convergent results calculated by a larger number of unoptimized orbitals. In addition, we demonstrate that the optimized orbitals significantly reduce the computational effort in the geometry optimization, while keeping a high degree of accuracy.

1 INTRODUCTION

During the last decade, to extend the applicability of density functional theories (DFT) to realistic large systems, great efforts have been done for developing O(N) methods of the eigenvalue problem [1, 2, 3, 4, 5, 6] and for making efficient and accurate localized orbitals [7, 8, 9, 10] as a basis set being suitable for O(N) methods. Among these studies, one of important and unresolved problems is how atomic orbitals as a basis set are constructed to maximize both the computational efficiency and accuracy. One expects that a basis set such as double valence orbitals with polarized orbitals for valence electrons provides a way for balancing a relatively small computational effort and a considerable degree of accuracy. Along this line, accurate basis sets were constructed in several ways [7, 8, 9, 10]. Kenny et al. constructed a basis set, so that atomic orbitals span the subspace defined by selected and occupied states of reference systems as much as possible [7]. Junquera et al. optimized the shape and cutoff radii of atomic orbitals for reference systems by using the downhill simplex method [8]. However, the transferability of these optimized orbitals might be restricted to systems similar to the reference systems used for the optimization in terms of atomic environments and states such as the coordination number and the charge state. A more complete treatment is to optimize atomic orbitals of each atom located on different environments in a given system [10]. In addition, the complete optimization procedure should be simple and efficient practically. In this paper, to overcome the difficulty, we present a simple and practical method, based on the force theorem, for variationally optimizing numerical atomic orbitals of each atom in a given system.

2 VARIATIONAL OPTIMIZATION

Let us expand a Kohn-Sham (KS) orbital ψμ of a given system using numerical atomic orbitals ϕiα in a form of linear combination of atomic orbitals (LCAO):

ψμ(𝐫) = iαcμ,iαϕiα(𝐫-𝐫i), (1)

where i is a site index, α(plm) an organized orbital index, and ϕiαYlmRiplm. For simplicity we consider only nonspin-polarized systems and an non-Bloch expression of the one-particle wave functions, but the extentions of the below description to spin-polarized systems and Bloch wave functions are straightforward. Note that a radial wave function Riplm depends on not only an angular momentum quantum number l, but also a site index i, a multiplicity index p, and a magnetic quantum number m. To give a variational degree of freedom of ϕiα, we furthermore expand ϕiα using primitive orbitals χiη as follows:

ϕiα(𝐫) = qaiαqχiη(𝐫), (2)

where η(qlm), in which the indices l and m denote the same as those of the index α, and χiηYlmRiql. Note that a primitive radial wave function Riql, which is discussed later on, is independent on m, and that the coefficients aiαq are independent variables on the eigenstate μ. Substituting Eq. (2) into Eq. (1), we have

ψμ(𝐫) = iαqcμ,iαaiαqχiη(𝐫-𝐫i). (3)

Although the expansion of a KS orbital by Eq. (3) is linearized for each variable cμ,iα or aiαq, however, the primitive orbitals χiη are expanded by the product of two variables cμ,iα and aiαq in a nonlinearized form. Therefore, it is difficult to directly find the minimum of the KS total energy Etot for the ground state with respect to cμ,iα and aiαq as a generalized eigenvalue problem which can be derived in the usual LCAO. To avoid the difficulty, here, we propose a two step optimization scheme, in which the coefficients aiαq are optimized after cμ,iα are determined with a set of fixed aiαq. Considering Etot/cμ,iα=0 for the KS total energy Etot with the orthonormalization relation ψμ|ψν=δμν among one-particle wave functions ψμ and fixed contraction coefficients aiαq, we have a well-known KS matrix equation with respect to the coefficient cμ,iα as follows:

jβϕiα|H^|ϕjβcμ,jβ = εμjβϕiα|ϕjβcμ,jβ, (4)

where H^ is a KS Hamiltonian, and εμ is a KS eigenvalue of the system. There is no restriction to solve Eq. (4) or to find Etot/cμ,iα=0. So, we can use any solution method which could be an exact diagonalization method, iterative methods such as Car-Parinello (CP) method [11] and conjugate gradient (CG) method [12], and O(N) methods. On the other hand, regarding cμ,iα as dependent variables on aiαq and assuming that the Kohn-Sham equation is solved self-consistently with respect to cμ,iα, we can derive the following equation based on the force derivation of non-orthogonal orbitals as follows:

Etotaiαq = δEtotδρ(𝐫)δρ(𝐫)δaiαq (5)
= 4μnμiα,jβcμ,iαcμ,jβϕiαaiαq|H^|ϕjβ+4μnμiα,jβcμ,iαaiαqcμ,jβϕiα|H^|ϕjβ
= 2jβ(Θiα,jβχiη|H^|ϕjβ-Eiα,jβχiη|ϕjβ),

where nμ is an occupancy number for the eigenstate μ, Θiα,jβ a bond-order, and Eiα,jβ an energy bond-order. The final equation in Eq. (5) is derived by taking into account Eq. (4) and the orthonormalization relation ψμ|ψν=δμν. It should be noted that Eq. (5) excludes any derivative, and that Θiα,jβ and Eiα,jβ only have to be evaluated for the contracted atomic orbital ϕiα in Eq. (5), which implies that additional computational costs are not required to evaluate Eq. (5). Once we obtain a self-consistent solution of the Kohn-Sham equation, Eq. (4), with a set of given coefficients aiαq, then Eq. (5) gives the gradient of Etot with respect to aiαq within small computational costs. This fact shows apparently that the atomic orbitals can be optimized variationally in the same two step procedure as that of the geometry optimization in terms of aiαq instead of atomic positions. Therefore, the contraction coefficients aiαq are optimized iteratively, coupled with the self-consistent solution of Eq. (4), as follows:

Step 1 Self-consistently solving of Eq. (4),
Step 2 aiαq(n+1)=aiαq(n)-λ(Etotaiαq)a(n),
n:=n+1,

where an optimum λ is determined, so that the norm of the gradients at a=a(n+1),

NG(n+1) = iα,q(Etotaiαq)a(n+1)2, (7)

becomes a minimum with respect to λ under the fixed Θiα,jβ and Eiα,jβ. Substituting Eqs. (5) and (2) into Eq. (7), and considering NG(n+1)/λ=0 with the fixed Θiα,jβ and Eiα,jβ, we have λ=B/A for the minimum of NG(n+1) with

A = iαq(jβqDiαq,jβq(Etotajβq)a(n))2, (8)
B = iαq,jβqDiαq,jβq(Etotaiαq)a(n)(Etotajβq)a(n), (9)

where

Diαq,jβq = Θiα,jβHiη,jη-Eiα,jβSiη,jη (10)

with Hiη,jηχiη|H^|χjη and Siη,jηχiη|χjη. Taking into account the sparseness of both the Hamitonian and overlap matrices in the real space, we find that the computational efforts to evaluate Eqs. (8) and (9) scale linearly. Therefore, we can easily evaluate λ, leading no intensive computational demands. After achieving the self-consistent field (SCF) for Eq. (4) with respect to the coefficients cμ,iα by an usual SCF procedure, the contraction coefficients aiαq are updated by Eq. (2) and renormalized so that ϕiα is normalized. Thus, the two step optimization scheme enables us to optimize the contraction coefficients aiαq along the stationary minimum line of the KS total energy functional with respect to cμ,iα, while keeping ψμ|ψν=δμν. It is found that about five iterative procedures of the two step optimization, which includes the solution of Eq. (4) and the optimization of aiαq by Eq. (2), are enough to accomplish a sufficient convergence of aiαq for our test systems. Again it should be mentioned that the bond-order and the energy bond-order are required for only the contracted atomic orbital ϕiα in Eq. (5). This is a crucial point to make our optimization procedure efficient, since the Kohn-Sham equation based on Eq. (4) can be solved for not large χiη, but small ϕiα. Once the contraction coefficients aiαq are fixed after the orbital optimization, the Hamiltonian and overlap matrices are directly constructed for the small ϕiα without constructing the elements for the larger primitive orbitals, since we can directly utilize the contracted orbital ϕiα as a numerical table because of the use of numerical orbitals, which is also a reason why the optimization scheme could be totally efficient.

A rather technical but important problem still remains in the application of the two step optimization method. To avoid the orbital optimization to a local minimum, we have developed the following careful procedure to provide a good initial guess for a set of coefficients aiαq:

(I) The partition of the system. A cluster is constructed including the nearest neighboring atoms j for each atom i.

(II) Solving of the Kohn-Sham equation of each cluster. By non self-consistently solving the Kohn-Sham equation of each cluster which is centered on an atom i, we obtain the coefficients dν,iqlm for the atom i of an one-particle wave function

φν(i) = jqlmdν,jqlmχjqlm (11)

with an eigenvalue ϵν(i).

(III) Construction of a from d. Then, ai0lmq is given as

ai0lmq = Nνsgn(dν,i0lm)dν,iqlmf((ϵν(i)-μi)/kBT), (12)

where f is the Fermi function, μi a local chemical potential for the cluster i, and N a normalization factor. For 0<p, the coefficients aiplmq are generated by the Gram-Schmidt orthonormalization from ai0lmq and dν,iqlm in order of the magnitude of f((ϵν(i)-μi)/kBT)q|dν,iqlm|.

To find a good initial guess for the coefficients aiαq, we tried to estimate the ratio of coefficients aiαq of the eigenstates of the whole system expanded by χiη from the local cluster for each atom i by the above treatment. Then, the eigenstates of the cluster are weighted by the Fermi function, so that the contribution of the lower states is taken into account as much as possible. Also, the contraction coefficients aiplmq for 0<p are generated using the Gram-Schmidt method to avoid the overcompleteness of contracted basis orbitals. We found that the procedure provides good initial coefficients aiαq in all of our test systems, and did not observe that the orbital optimization is trapped to any serious local minimum, while the other trial was trapped to a local minimum often. The additional cost for the above procedure (I)-(III) is almost negligible, when the orbital optimization method is applied as a preconditioning of the geometry optimization as discussed later on.

3 PRIMITIVE ORBITALS

The primitive orbitals χiη we used are eigenstates of an atomic Kohn-Sham equation with confinement pseudo potentials [8, 13]. To vanish the radial wave function Riql of the outside of the confinement radius rc, we modify the atomic core potential Vcore(r) in the all electron calculation of an atom and the generation of pseudo potential as follows:

Vcore(r) = {-Zrfor rr1,n=03bnrnfor r1<rrc,hfor rc<r, (13)

where b0, b1, b2, and b3 are determined, so that the value and the first derivative are continuous at both r1 and rc. Figure 1 shows radial wave functions for l=0 of a carbon atom under the confinement pseudo potential. The eigenstates construct an orthonormal basis set at the same atomic position and vanish beyond rc within the double precision. Because of the complete vanishing tail of numerical orbitals, we find that non-zero elements of Hamiltonian and overlap matrices can be exactly proportional to the number of atoms.


Figure 1: The radial wave function for l=0 of a carbon atom under the confinement pseudo potential obtained from Eq. (13), where 4.5 (a.u.), 4.3 (a.u.), and 3.0× 104 (Hartree) are used for rc, r1 and h, respectively.

In Fig. 2 the total energy for a carbon dimer calculated using the eigenstates as a basis set is shown as a function of the number of orbitals for various cutoff radii rc. Factorized norm conserving pseudo potentials [13] and the local density approximation (LDA) [14] to the exchange-correlation interactions were used in our all DFT calculations. Also the real space grid techniques were used with the energy cutoff of 113 (Ryd) for numerical integrations [8]. As the cutoff radius and the number of orbitals increase, the total energy converges systematically. Thus, we see that the primitive orbitals χiη itself are systematic basis sets controlled by two simple parameters, the cutoff radius and the number of orbitals, in the same manner as spherical wave basis sets [9]. In addition, a relatively small number of orbitals may be needed to obtain the convergent result compared to the spherical wave basis sets, since the primitive basis set is prepared for each element, unlike the spherical wave basis sets [9]. These are reasons why we use the eigenstates of an atomic Kohn-Sham equation with the confinement pseudo potentials as the primitive orbitals. A systematic study for convergence properties as a function of the cutoff radius and the number of orbitals will be presented for several elements including first row elements, alkaline metals and transition metals elsewhere.


Figure 2: The total energy for a carbon dimer calculated using the eigenstates as a basis set as a function of the number of basis orbitals per atom for the cutoff radius rc of 3.5, 4.0, 4.5, 5.0, 5.5 and 6.0 (a.u.).

For the later discussion, here, we introduce an abbreviation of the basis orbital as C4.5-s62*p62, where C indicates the atomic symbol, 4.5 is the cutoff radius rc (a.u.) used in the generation, s62 means that two optimized orbitals are constructed from six primitive orbitals for the s-orbital, and the symbol * signifies the restricted optimization that the radial wave function R is independent on the index m. In case of snn such as s66, corresponding to no optimization, snn can be simplified as sn.

4 NUMERICAL RESULTS

Figure 3 shows the convergence properties of total energies for a carbon dimer C2, a methane molecule CH4, and the diamond as a function of the number of unoptimized and optimized orbitals. The orbital optimization was done by five iterative steps according to Eq. (2), in which each step includes ten SCF loops. We see that the unoptimized orbitals provide systematic and rapid convergent results for not only molecules C2 and CH4, but also a bulk system diamond, as the number of orbitals increase. Moreover, remarkable convergent results are obtained using the optimized orbitals for all systems. The small optimized orbitals rapidly converge to the total energies calculated by a larger number of unoptimized orbitals, which implies that the computational effort can be reduced significantly with a high degree of accuracy. For three systems the effect of the restriction for the orbital optimization is almost negligible, which encourages us to use the restriction, since the restricted optimization guarantees the rotational invariance of the total energy. In Fig. 4 the radial parts of the minimal orbitals obtained by the restricted optimization for the diamond are shown with those of the lowest primitive orbitals of a carbon atom for comparison. It is observed that the tails of both the optimized s- and p-orbitals shrink compared to the primitive orbitals, which clearly reveals that the basis orbital can automatically vary within the cutoff radius to minimize the total energy.


Figure 3: The total energy for a carbon dimer C2, a methane CH4, and the diamond as a function of the number of unoptimized (unopt) orbitals and optimized orbitals with (rest) and without (unrest) the restriction. The total energy and the number of orbitals are defined as those per atom for C2 and the diamond, and as those per molecule for CH4. The energy cutoff of 113, 113, and 222 (Ryd) were used for the numerical integrations in C2, CH4, and the diamond, respectively. The two step convergence of C2 is due to the inclusion of d-orbitals.


Figure 4: The radial wave function of the minimal orbitals obtained by the restricted optimization for the diamond and the lowest primitive orbitals of a carbon atom. The optimization was done in the same conditions as those in Fig. 3.

Finally, as an illustration of the orbital optimization, we performed the geometry optimization with the orbital optimization as a preconditioning for the most stable conformer of a neutral glycine molecule [15, 16] which is the smallest amino acid. Before doing the geometry optimization, the orbital optimization was performed by five iterative steps, which includes ten SCF loops per step, for an initial structure optimized by a molecular mechanics (MM). Then, the geometry optimization was done using the optimized orbitals by fifty steepest decent (SD) steps with a variable prefactor for accelerating the convergence, which includes twenty SCF loops per step. The optimized geometrical parameters are given in Table 1 together with the total energy and the computational time per MD step. In case of the unoptimized orbitals SN, TN, and TNDP, as the number of orbitals increase, we find the decrease of the total energy and the convergent geometrical parameters comparable to the experimental [16] and the other theoretical values [15]. Although there are some deviations in the optimized parameters calculated using TNDP from the other theoretical values [15], the deviations may be attributed to the pseudo potentials rather than the basis orbitals, since we verified that the optimized parameters of the glycine depend on the cutoff radii in the pseudo potential generation. Comparing to the unoptimized and optimized minimal orbitals SN and SN, it is found that the geometrical parameters are significantly improved without increasing the computational time. In case of the optimized orbitals SNP remarkable improvements are obtained in both the geometrical parameters and the computational time. The optimized orbitals SNP provide a convergent result comparable to TNDP with a great reduction of the computational time. The computational time required for the orbital optimization of SN occupies only 3 % of that of the whole calculation. So the orbital optimization can be regarded as a preconditioning before doing the geometry optimization or the molecular dynamics. Of course, it is possible to perform the orbital optimization during the geometry optimization. It is worth mentioning that the orbital optimization can be combined with an O(N) method [1, 2, 3, 4, 5, 6], since only Θiα,jβ and Eiα,jβ, which are calculated by the O(N) method, are required in Eq. (5). Therefore, the orbital optimization can be applied to large-scale systems in O(N) operations.

Table 1: Optimized geometrical parameters (Å and degrees) of the most stable conformer of a neutral glycine molecule. A denotes the atomic symbol C, N, or O. The computational time per MD step was measured using one CPU on a Sharp Mebius PC-GP1-C7U. The energy cutoff of 113 (Ryd) was used for the numerical integrations in all calculations. The results by the other theory were taken from Ref. [15], and the experimental values from Ref. [16].

SN TN TNDP SN SNP Other theory Expt.
H4.0-s1 H4.0-s3 H4.0-s3p2 H4.0-s31* H4.0-s31*p21* LDA/DZP
A4.5-s1p1 A4.5-s3p3 A4.5-s3p3d2 A4.5-s31*p31* A4.5-s32*p31*d21* Full potential
r(C-C) 1.555 1.535 1.528 1.515 1.528 1.510 1.532
r(N-C) 1.530 1.480 1.490 1.502 1.444 1.439 1.469
r(C=O) 1.353 1.231 1.235 1.281 1.238 1.218 1.207
r(C-O) 1.498 1.365 1.349 1.416 1.350 1.348 1.357
r(O-H) 1.144 0.998 0.987 1.010 0.995 0.988 -
(NCC) 104.8 106.5 108.2 108.4 108.8 114.8 112.1
(CC=O) 136.8 127.9 128.3 128.9 125.9 124.9 125.1
(COH) 96.8 107.9 105.7 105.8 106.8 105.6 -
C=ON 3.132 2.998 2.905 2.998 2.882 2.827 -
Energy (Hartree) -55.662 -55.981 -56.106 -55.818 -56.036 - -
Time(s)/MD step 32 86 217 34 84 - -

5 CONCLUSIONS

To conclude, we have developed a simple and practical method based on the force theorem for variationally optimizing numerical atomic orbitals used in density functional calculations. The optimization algorithm similar to the geometry optimization allows us to fully optimize atomic orbitals within a cutoff radius for each atom in a given system. The illustration of geometry optimization with the orbital optimization for a small molecule clearly shows that the small optimized orbitals promise to greatly reduce the computational effort with a high degree of accuracy.


ACKNOWLEDGMENTS

We would like to thank H. Kino for helpful suggestions and discussions. This work was partly supported by NEDO under the Nanotechnology Materials Program.

References

  • [1] W. Yang, Phys. Rev. Lett. 66, 1438 (1991).
  • [2] S. Goedecker and L. Colombo, Phys. Rev. Lett. 73, 122 (1994).
  • [3] G. Galli and M. Parrinello, Phys. Rev. Lett. 69, 3547 (1992).
  • [4] X.-P. Li, R. W. Nunes, and D. Vanderbilt, Phys. Rev. B 47, 10891 (1993); M. S. Daw, Phys. Rev. B 47, 10895 (1993).
  • [5] T. Ozaki and K. Terakura, Phys. Rev. B 64, 195126 (2001).
  • [6] S. Goedecker, Rev. of Mod. Phys. 71, 1085 (1999) and references therein.
  • [7] S. D. Kenny, A. P. Horsfield, and H. Fujitani, Phys. Rev. B 62, 4899 (2000).
  • [8] J. Junquera, O´. Paz, D. Sa´nchez-Portal, and E. Artacho, Phys. Rev. B 64, 235111 (2001); J. M. Soler et al., J. Phys.:Condens. Matter 14, 2745 (2002) and references therein.
  • [9] C. K. Gan, P. D. Haynes, and M. C. Payne, Phys. Rev. B 63, 205109 (2001).
  • [10] J. D. Talman, Phys. Rev. Lett. 84, 855 (2000).
  • [11] R. Car and M. Parrinello, Phys. Rev. Lett. 55, 2471 (1985).
  • [12] M. C. Payne, M. P. Teter, D. C. Allan, T. A. Arias and J. D. Joannopoulos, Rev. Mod. Phys. 64, 1045(1992) and references therein.
  • [13] G. B. Bachelet, D. R. Hamann, and M. Schlu¨ter, Phys. Rev. B 26, 4199 (1982); L. Kleinman and D. M. Bylander, Phys. Rev. Lett. 48, 1425 (1982).
  • [14] J. P. Perdew and A. Zunger, Phys. Rev. B 23, 5048 (1981).
  • [15] V. Barone, C. Adamo, and F. Lelj, J. Chem. Phys. 102, 364 (1995).
  • [16] K. Iijima, K. Tanaka, and S. Onuma, J. Mol. Struct. 246, 257 (1991).