CRISPR/Cas9-mediated gene editing in human tripronuclear zygotes (original) (raw)

Journal Article

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

,

Guangdong Province Key Laboratory of Reproductive Medicine, the First Affiliated Hospital, and Key Laboratory of Gene Engineering of the Ministry of Education, School of Life Sciences

,

Sun Yat-sen University

, 510275, Guangzhou,

China

Search for other works by this author on:

... Show more

Puping Liang, Yanwen Xu, Xiya Zhang and Chenhui Ding have contributed equally to this work.

Author Notes

Cite

Puping Liang, Yanwen Xu, Xiya Zhang, Chenhui Ding, Rui Huang, Zhen Zhang, Jie Lv, Xiaowei Xie, Yuxi Chen, Yujing Li, Ying Sun, Yaofu Bai, Zhou Songyang, Wenbin Ma, Canquan Zhou, Junjiu Huang, CRISPR/Cas9-mediated gene editing in human tripronuclear zygotes, Protein & Cell, Volume 6, Issue 5, May 2015, Pages 363–372, https://doi.org/10.1007/s13238-015-0153-5
Close

Navbar Search Filter Mobile Enter search term Search

Abstract

Genome editing tools such as the clustered regularly interspaced short palindromic repeat (CRISPR)-associated system (Cas) have been widely used to modify genes in model systems including animal zygotes and human cells, and hold tremendous promise for both basic research and clinical applications. To date, a serious knowledge gap remains in our understanding of DNA repair mechanisms in human early embryos, and in the efficiency and potential off-target effects of using technologies such as CRISPR/Cas9 in human pre-implantation embryos. In this report, we used tripronuclear (3PN) zygotes to further investigate CRISPR/Cas9-mediated gene editing in human cells. We found that CRISPR/Cas9 could effectively cleave the endogenous β-globin gene (HBB). However, the efficiency of homologous recombination directed repair (HDR) of HBB was low and the edited embryos were mosaic. Off-target cleavage was also apparent in these 3PN zygotes as revealed by the T7E1 assay and whole-exome sequencing. Furthermore, the endogenous delta-globin gene (HBD), which is homologous to HBB, competed with exogenous donor oligos to act as the repair template, leading to untoward mutations. Our data also indicated that repair of the HBB locus in these embryos occurred preferentially through the non-crossover HDR pathway. Taken together, our work highlights the pressing need to further improve the fidelity and specificity of the CRISPR/Cas9 platform, a prerequisite for any clinical applications of CRSIPR/Cas9-mediated editing.

Introduction

The CRISPR/Cas9 RNA-endonuclease complex, consisting of the Cas9 protein and the guide RNA (gRNA) (~99 nt), is based on the adaptive immune system of streptococcus pyogenes SF370. It targets genomic sequences containing the tri-nucleotide protospacer adjacent motif (PAM) and complementary to the gRNA, and can be programmed to recognize virtually any genes through the manipulation of gRNA sequences (Cho et al., 2013; Cong et al., 2013; Jinek et al., 2012; Jinek et al., 2013; Mali et al., 2013c). Following Cas9 binding and subsequence target site cleavage, the double strand breaks (DSBs) generated are repaired by either non-homologous end joining (NHEJ) or homologous recombination directed repair (HDR), resulting in indels or precise repair respectively (Jinek et al., 2012; Moynahan and Jasin, 2010). The ease, expedience, and efficiency of the CRISPR/Cas9 system have lent itself to a variety of applications, including genome editing, gene function investigation, and gene therapy in animals and human cells (Chang et al., 2013; Cho et al., 2013; Cong et al., 2013; Friedland et al., 2013; Hsu et al., 2014; Hwang et al., 2013; Ikmi et al., 2014; Irion et al., 2014; Jinek et al., 2013; Li et al., 2013a; Li et al., 2013b; Long et al., 2014; Ma et al., 2014; Mali et al., 2013c; Niu et al., 2014; Smith et al., 2014a; Wu et al., 2013; Wu et al., 2014b; Yang et al., 2013).

The specificity of CRISPR/Cas9 is largely dictated by PAM and the 17–20 nt sequence at the 5′ end of gRNAs (Cong et al., 2013; Hsu et al., 2013; Mali et al., 2013a; Mali et al., 2013c; Pattanayak et al., 2013; Wu et al., 2014a). Up to 5 mismatches may be tolerated for target recognition in human cancer cells (Fu et al., 2013). Unintended mutation in the genome can greatly hinder the application of CRISPR/Cas9, especially in studies of development and gene therapy (Hsu et al., 2014; Mali et al., 2013b; Sander and Joung, 2014). Interestingly, three groups recently found through whole genome sequencing that off-target effects of CRISPR/Cas9 appeared rare in human pluripotent stem cells (Smith et al., 2014b; Suzuki et al., 2014; Veres et al., 2014), raising the possibility that high frequencies of unintended targeting by CRISPR/Cas9 may be more prevalent in cancer cell lines. Additionally, lower rates of off-target effects (compared to human cell lines) have also been reported in mouse zygotes (Wu et al., 2013; Yang et al., 2013). Despite great progress in understanding the utilization of CRISPR/Cas9 in a variety of model organisms, much remains to be learned regarding the efficiency and specificity of CRISPR/Cas9-mediated gene editing in human cells, especially in embryos. Because ethical concerns preclude studies of gene editing in normal embryos, we decided to use tripronuclear (3PN) zygotes, which have one oocyte nucleus and two sperm nuclei.

Extensive studies have shown that polyspermic zygotes such as tripronuclear (3PN) zygotes, discarded in clinics, may serve as an alternative for studies of normal human zygotes (Balakier, 1993). Polyspermic zygotes, which occur in ~2%–5% of zygotes during in vitro fertilization (IVF) clinical trials, may generate blastocysts in vitro but invariably fail to develop normally in vivo (Munne and Cohen, 1998), providing an ideal model system to examine the targeting efficiency and off-target effects of CRISPR/Cas9 during early human embryonic development (Bredenoord et al., 2008; Sathananthan et al., 1999).

Here, we report that the CRISPR/Cas9 system can cleave endogenous gene efficiently in human tripronuclear zygotes, and that the DSBs generated by CRISPR/Cas9 cleavage are repaired by NHEJ and HDR. Repair template of HDR can be either the endogenous homologous gene or exogenous DNA sequence. This competition between exogenous and endogenous sequence complicates the analysis of possible gene editing outcomes make it difficult to predict the consequence of gene editing. Furthermore, mosaicism and mutations at non-target sites are apparent in the edited embryos. Taken together, our data underscore the need to more comprehensively understand the mechanisms of CRISPR/Cas9-mediated genome editing in human cells, and support the notion that clinical applications of the CRISPR/Cas9 system may be premature at this stage.

Results

CRISPR/Cas9-mediated editing of HBB gene in human cells

The human β-globin (HBB) gene, which encodes a subunit of the adult hemoglobin and is mutated in β-thalassemia (Hill et al., 1962). In China, CD14/15, CD17, and CD41/42, which are frame-shift or truncated mutations of β-globin, are three of the most common β-thalassemia mutations (Cao and Galanello, 2010). Located on chromosome 11, HBB is within the β-globin gene cluster that contains four other globin genes with the order of (from 5′ to 3′) HBE, HBG2, HBG1, HBD, and HBB (Schechter, 2008). Because the sequences of HBB and HBD are very similar, HBD may also be used as a template to repair HBB. The HBD footprints left in the repaired HBB locus should enable us to investigate whether and how endogenous homologous sequences may be utilized as HDR templates, information that will prove invaluable to any future endeavors that may employ CRISPR/Cas9 to repair gene loci with repeated sequences.

Using online tools developed by Feng Zhang and colleagues (http://crispr.mit.edu/), we designed and generated three gRNAs (named G1, G2, and G3) that targeted different regions of the HBB gene (Fig. 1A), and transfected the gRNA-Cas9 expression vectors into human 293T cells. Compared with the GFP mock vector, G1 and G2 gRNAs exhibited efficient cleavage activities as determined by the T7E1 assay (Fig. 1B) (Shen et al., 2014). Sequencing analysis of the two regions targeted by G1 and G2 revealed distinct indel spectra, reflecting different NHEJ repair preferences at these two sites (Fig. S1). CRISPR/Cas9 targeting of the β-globin locus was previously reported to have substantially high off-target activity in cultured human cells (Cradick et al., 2013). We therefore designed specific PCR primers for the top 7 predicted off-target sites in the genome for both G1 and G2 gRNAs, along with the predicted off-target site of G1 gRNA in the HBD gene (Table S1). We then carried out the T7E1 assay to assess the off-target effects of G1 and G2 gRNAs in human 293T cells. While G2 gRNA showed very low off-target cleavage activity in the intergenic region (G2-OT4) (Fig. S2), gRNA G1 did not exhibit detectable off-target cleavage at the top 7 predicted off-target sites (Fig. 1C). Furthermore, we also failed to find sequence modifications at the predicted site in the HBD gene, despite close sequence similarity between HBD and HBB (Fig. 1D). These data suggest that the G1 gRNA to be a better candidate for further studies. Next, we synthesized a ssDNA oligo donor template that encoded 6 silent mutations and transfected this oligo alone or together with the G1 gRNA-Cas9 plasmid into 293T cells (Fig. 1E). We then extracted genomic DNA from the cells 48 h later for PCR amplification of the G1 target region. The PCR products were subsequently subcloned for sequencing. Compared to none from oligo-only control, analysis of 29 independent clones revealed 14 clones (48.3%) that perfectly matched the donor oligo template (Fig. 1E), indicating high efficiency of our approach and precise editing of the HBB locus in cells.

Targeting of theHBBgene in human cells using CRISPR/Cas9. (A) Three gRNA targeting sites were selected for the HBB locus, and the sequence for each gRNA (G1, G2, and G3) is shown with the PAM sequence in green. The three common HBB mutations found in β-thalassemia are indicated in red. Exons are represented by deep blue boxes with yellow arrows indicating transcriptional direction. (B) 293T cells were individually transfected with the three gRNA-Cas9 expression vectors and harvested for genomic DNA isolation 48 h after transfection. A GFP expression vector was used as transfection control. The regions spanning the gRNA target sites were then PCR amplified for the T7E1 assay. Blue arrowhead indicates the expected size for uncut (no mismatch) PCR products. (C) 293T cells were transfected with increasing concentrations (1 μg, 2 μg, 3 μg, 4 μg) of the G1 gRNA-Cas9 vector. A GFP expression vector was used as transfection control. Regions spanning the top 7 predicted off-target sites for each gRNA were PCR amplified for the T7E1 assay. OT, off-target. HBB, on-target editing in the HBB gene locus. (D) The region within the HBD locus that is highly similar to the G1 gRNA-Cas9 target sequence was analyzed as in (C). (E) A ssDNA oligo (Oligo donor) encoding 6 silent mutations (indicated in red) was synthesized (top), and co-transfected with the G1 gRNA-Cas9 construct (pX330-G1) into 293T cells (middle). At 48 h after transfection, genomic DNA was extracted to PCR amplify the region spanning the G1 target site. The PCR products were then subcloned into TA cloning vectors for sequencing analysis. Representative sequencing chromatographs for wild-type and edited alleles are shown with the mutated target region underlined in red (bottom)

Figure 1

Targeting of the HBB gene in human cells using CRISPR/Cas9. (A) Three gRNA targeting sites were selected for the HBB locus, and the sequence for each gRNA (G1, G2, and G3) is shown with the PAM sequence in green. The three common HBB mutations found in β-thalassemia are indicated in red. Exons are represented by deep blue boxes with yellow arrows indicating transcriptional direction. (B) 293T cells were individually transfected with the three gRNA-Cas9 expression vectors and harvested for genomic DNA isolation 48 h after transfection. A GFP expression vector was used as transfection control. The regions spanning the gRNA target sites were then PCR amplified for the T7E1 assay. Blue arrowhead indicates the expected size for uncut (no mismatch) PCR products. (C) 293T cells were transfected with increasing concentrations (1 μg, 2 μg, 3 μg, 4 μg) of the G1 gRNA-Cas9 vector. A GFP expression vector was used as transfection control. Regions spanning the top 7 predicted off-target sites for each gRNA were PCR amplified for the T7E1 assay. OT, off-target. HBB, on-target editing in the HBB gene locus. (D) The region within the HBD locus that is highly similar to the G1 gRNA-Cas9 target sequence was analyzed as in (C). (E) A ssDNA oligo (Oligo donor) encoding 6 silent mutations (indicated in red) was synthesized (top), and co-transfected with the G1 gRNA-Cas9 construct (pX330-G1) into 293T cells (middle). At 48 h after transfection, genomic DNA was extracted to PCR amplify the region spanning the G1 target site. The PCR products were then subcloned into TA cloning vectors for sequencing analysis. Representative sequencing chromatographs for wild-type and edited alleles are shown with the mutated target region underlined in red (bottom)

CRISPR/Cas9-mediated editing of HBB gene in human tripronuclear zygotes

To investigate the specificity and efficacy of gene targeting in human tripronuclear (3PN) zygotes, we co-injected G1 gRNA, Cas9 mRNA, GFP mRNA, and the ssDNA oligo into the cytoplasm of human 3PN zygotes in different concentration combinations (Fig. 2A). Based on morphology, ~80% of the embryos remained viable 48 h after injection (Fig. 2A), in agreement with low toxicity of Cas9 injection in mouse embryos (Wang et al., 2013; Yang et al., 2013). All GFP-positive embryos were then collected for whole-genome amplification by multiplex displacement amplification (Dean et al., 2002; Hosono et al., 2003), followed by PCR amplification of the G1 gRNA target region and sequencing. Of the 54 PCR-amplified embryos, 28 were cleaved by Cas9, indicating an efficiency of ~52% (Fig. 2A). Furthermore, 4 of the 28 Cas9-cleaved embryos (14.3%) were clearly edited using the ssDNA oligo as a repair template (Fig. 2A). Additionally, 7 embryos contained four identical point mutations in tandem, an clear indication of HDR using the HBD gene as a repair template (Fig. 2A and 2B). This finding suggests recombination of the HBB gene with HBD in 7 out of the 28 cleaved embryos (25%), even in the presence of co-injected exogenous ssDNA donor template (Fig. 2A and 2B). Similar observations have been found in mouse embryos, where endogenous homologous templates were found to compete with ssDNA oligos for HDR repair (Wu et al., 2013).

Targeting of theHBBgene in human tripronuclear (3PN) zygotes using CRISPR/Cas9. (A) Four groups of 3PN zygotes were injected intra-cytoplasmically with GFP mRNA (50 ng/μL) and Cas9/gRNA/ssDNA in different concentration combinations. The genomes of GFP+ embryos were first amplified by multiplex displacement amplification. The region spanning the target site was then PCR amplified, subcloned into TA vectors, and sequenced. * Indicates that target fragments in 5 GFP+ embryos failed to be PCR amplified. (B) Sequencing chromatographs of the wild-type allele and recombined allele generated by homologous recombination between HBB and HBD are shown here. The region with base substitution is underlined with red line. (C) A representative sequencing chromatogram of the region spanning the target site in Cas9-cleaved 3PN embryos. Double peaks near the PAM sequence (green) are indicated. (D) Five embryos with double peaks near the PAM sequence were randomly selected for the T7E1 assay. Blue arrowhead indicates the expected size for uncut PCR products. Control, amplified products from target regions with no double peaks near the PAM sequence. (E) Embryo No.16 from group 3 was used to PCR amplify sequences spanning the gRNA target regions of the HBB gene. The PCR products were then subcloned and sequenced. A total of 50 clones were examined, and the number of clones for each pattern indicated. PAM, green. G1 gRNA sequence, blue. Point mutations, red

Figure 2

Targeting of the HBB gene in human tripronuclear (3PN) zygotes using CRISPR/Cas9. (A) Four groups of 3PN zygotes were injected intra-cytoplasmically with GFP mRNA (50 ng/μL) and Cas9/gRNA/ssDNA in different concentration combinations. The genomes of GFP+ embryos were first amplified by multiplex displacement amplification. The region spanning the target site was then PCR amplified, subcloned into TA vectors, and sequenced. * Indicates that target fragments in 5 GFP+ embryos failed to be PCR amplified. (B) Sequencing chromatographs of the wild-type allele and recombined allele generated by homologous recombination between HBB and HBD are shown here. The region with base substitution is underlined with red line. (C) A representative sequencing chromatogram of the region spanning the target site in Cas9-cleaved 3PN embryos. Double peaks near the PAM sequence (green) are indicated. (D) Five embryos with double peaks near the PAM sequence were randomly selected for the T7E1 assay. Blue arrowhead indicates the expected size for uncut PCR products. Control, amplified products from target regions with no double peaks near the PAM sequence. (E) Embryo No.16 from group 3 was used to PCR amplify sequences spanning the gRNA target regions of the HBB gene. The PCR products were then subcloned and sequenced. A total of 50 clones were examined, and the number of clones for each pattern indicated. PAM, green. G1 gRNA sequence, blue. Point mutations, red

Because of the preference for the error-prone NHEJ pathway, the HBB sequences from Cas9-cleaved embryos showed double peaks near the PAM site on sequencing chromatographs (Fig. 2C). Analysis of 5 of these embryos using the T7E1 assay also confirmed successful cleavage by G1 gRNA and Cas9 (Fig. 2D). In addition, the gene-edited embryos were mosaic. For example, embryo No. 16 contained many different kinds of alleles (Fig. 2E).

CRISPR/Cas9 has off-target effect in human tripronuclear embryos

To determine the off-target effects of CRISPR/Cas9 in these embryos, we again examined the top 7 potential off-target sites plus the site in the HBD gene. The T7E1 assay revealed off-target cleavage in the OPCML intron (G1-OT4) and the TULP1 intron (G1-OT5) (Figs. 3A, S3 and S4), although none of these sites appeared to be cleaved in human 293T cells (Fig. 1C). We then randomly selected 6 _HBB_-cleaved embryos (three each from groups 2 and 3, Fig. 2A) for whole-exome sequencing. As shown in Fig. 3B, on-target indels were identified in all of the samples. Two candidate off-target sites within exons were found, where lower concentration of the Cas9 mRNA and gRNA had been used (sample A and C, Fig. 3B), and further confirmed through the T7E1 assay (Fig. S5). These two sites reside in the exons of the C1QC and Transthyretin (TTR) gene, both of which closely match the G1 gRNA sequence in the seed region (Fig. S6). These data demonstrate that CRISPR/Cas9 has notable off-target effects in human 3PN embryos.

Off-target cleavage of CRISPR/Cas9 in human 3PN embryos. (A) Off-target cleavage in human embryos was summarized here. PAM sequence are labeled in green. HBB, on-target cleavage of the HBB locus. OT1–7, the top 7 predicted off-target sites. HBD, the predicted off-target site in the HBD locus. Mismatched nucleotides compared to the HBB locus are labeled in red. Some of the off-target sites failed to be amplified by PCR in this experiment. (B) Six Cas9-cleaved embryos were randomly selected (three each from groups 2 and 3) for whole-exome sequencing. Concentrations of the Cas9/gRNAs used for injections are indicated. Candidate off-target sites were also confirmed by T7E1 assay

Figure 3

Off-target cleavage of CRISPR/Cas9 in human 3PN embryos. (A) Off-target cleavage in human embryos was summarized here. PAM sequence are labeled in green. HBB, on-target cleavage of the HBB locus. OT1–7, the top 7 predicted off-target sites. HBD, the predicted off-target site in the HBD locus. Mismatched nucleotides compared to the HBB locus are labeled in red. Some of the off-target sites failed to be amplified by PCR in this experiment. (B) Six Cas9-cleaved embryos were randomly selected (three each from groups 2 and 3) for whole-exome sequencing. Concentrations of the Cas9/gRNAs used for injections are indicated. Candidate off-target sites were also confirmed by T7E1 assay

HDR of double strand breaks at the HBB gene occurs preferentially through the non-crossover pathway

DSBs can be repaired through either error-prone NHEJ or high-fidelity HDR (Ciccia and Elledge, 2010; Moynahan and Jasin, 2010). There are three options for the HDR pathway, non-crossover synthesis-dependent strand annealing (SDSA), non-crossover double-strand break repair (DSBR), and crossover DSBR (Fig. 4A). Bi-directional sequence exchange between the recombined genes occurs with crossover, while uni-directional sequence exchange occurs in absence of crossover. Of the 3PN embryos examined thus far, 4 were repaired using the ssDNA oligo as template and 7 were recombined with the endogenous HBD gene (Fig. 2A). When the _HB_D locus from the 7 recombined 3PN embryos were amplified and examined, we found that the HBD locus in the 5 successfully-amplified embryos remained intact, containing no HBB sequences (Fig. 4B). This lack of bi-directional sequence exchange supports the notion that the HBB gene was repaired primarily through non-crossover HDR (San Filippo et al., 2008). It is possible that one of the alleles in 3PN embryo No.16 (group 3) (Fig. 2E), which only contained 4 of the 6 silent mutations from the ssDNA oligo, might have been generated by non-crossover pathway as well (Fig. 4A). Taken together, our results suggest that homologous recombination in human early embryos preferentially occur through the non-crossover HDR pathway (Fig. 4C), similar to what has been observed in human iPS cells (Byrne et al., 2014).

Repair of double-strand breaks at theHBBgene in human early embryos occurs preferentially through the non-crossover pathway when HDR is utilized. (A) In human cells, DSBs may be repaired through the double-strand break repair (DSBR) pathway or the non-crossover synthesis-dependent strand annealing (SDSA) pathway. Both crossover and non-crossover DSBR can occur. (B) The HBD locus from the 7 recombined 3PN embryos were similarly examined as above. * Indicates that the HBD locus failed to be amplified in two of the embryos. (C) In human embryos, repair of DSBs generated by CRISPR/Cas9 occurs mainly through NHEJ. If HDR is utilized, the non-crossover pathway is preferred

Figure 4

Repair of double-strand breaks at the HBB gene in human early embryos occurs preferentially through the non-crossover pathway when HDR is utilized. (A) In human cells, DSBs may be repaired through the double-strand break repair (DSBR) pathway or the non-crossover synthesis-dependent strand annealing (SDSA) pathway. Both crossover and non-crossover DSBR can occur. (B) The HBD locus from the 7 recombined 3PN embryos were similarly examined as above. * Indicates that the HBD locus failed to be amplified in two of the embryos. (C) In human embryos, repair of DSBs generated by CRISPR/Cas9 occurs mainly through NHEJ. If HDR is utilized, the non-crossover pathway is preferred

Discussion

In this study, we used 3PN zygotes to investigate the specificity and fidelity of the CRISPR/Cas9 system. Similar to cultured human cells, most of the DSBs generated by Cas9 in 3PN zygotes were also repaired through NHEJ (Fig. 2A). ssDNA-mediated editing occurred only in 4 embryos (14.3%), and the edited embryos were mosaic, similar to findings in other model systems (Shen et al., 2013; Yang et al., 2013; Yen et al., 2014). Endogenous homologous sequences were also used as HDR templates, with an estimated editing efficiency of 25% (Fig. 2A). This high rate of repair using endogenous sequences presents obvious obstacles to gene therapy strategies using CRISPR/Cas9, as pseudogenes and paralogs may effectively compete with exogenous templates (or endogenous wild-type sequences) during HDR, leading to unwanted mutations (Fig. 2B).

Our whole-exome sequencing result only covered a fraction of the genome and likely underestimated the off-target effects in human 3PN zygotes. In fact, we found that even with an 8 bp mismatch between the G1 gRNA and C1QC gene (Fig. S6), the CRISPR/Cas9 system was still able to target the C1QC locus in human 3PN embryos (Figs. 3B and S5). Such off-target activities are similar to what was observed in human cancer cells. Because the edited embryos are genetically mosaic, it would be impossible to predict gene editing outcomes through pre-implantation genetic diagnosis (PGD). Our study underscores the challenges facing clinical applications of CRISPR/Cas9.

Further investigation of the molecular mechanisms of CRISPR/Cas9-mediated gene editing in human model is sorely needed. In particular, off-target effect of CRISPR/Cas9 should be investigated thoroughly before any clinical application (Baltimore et al., 2015; Cyranoski, 2015; Lanphier et al., 2015).

Materials and Methods

Construction and use of CRISPR plasmids

pX330 (Addgene, #42230) was used for transient transfection and pDR274 (Addgene, #42250) was used for in vitro transcription. We amplified the sequences encoding 3×Flag-tagged hCas9 from pX330 and cloned it into the _Not_I/_Age_I restriction sites of pDR274 to obtain pT7-3×Flag-hCas9. The pT7-3×Flag-hCas9 plasmid was linearized with PmeI and in vitro transcribed using the mMESSAGE mMACHINE T7 ULTRA kit (Life Technologies). The pDR274 vector encoding gRNA sequences was in vitro transcribed using the MEGAshortscript T7 kit (Life Technologies). The Cas9 mRNA and the gRNAs were subsequently purified with the MEGAclear kit (Life Technologies), resuspended in RNase-free water, and quantified using NanoDrop-1000.

Sequences for cloning the G1, G2, and G3 gRNAs into the pX330 vector are: pX330-G1-FP: CACCGTAACGGCAGACTTCTCCTC; pX330-G1-RP: AAACGAGGAGAAGTCTGCCGTTAC; pX330-G2-FP: CACCGTCTGCCGTTACTGCCCTGT; pX330-G2-RP: AAACACAGGGCAGTAACGGCAGAC; pX330-G3-FP: CACCGGCTGCTGGTGGTCTACCCT; pX330-G3-RP: AAACAGGGTAGACCACCAGCAGCC; Sequences for cloning the G1 gRNA into pDR274 are: pDR274-G1-FP: TAGGTAACGGCAGACTTCTCCTC; pDR274-G1-RP: AAACGAGGAGAAGTCTGCCGTTA.

The sequence for the ssDNA oligo used to repair HBB is: 5′-CAACCTGCCCAGGGCCTCACCACCAACTTCATCCACGTTCACCTTGCCCCACAGGGCAGTGACAGCGGATTTTTCTTCAGGAGTCAGATGCACCATGGTGTCTGTTTGAGGTTGCTAGTGAACAC-3′

Identification and collection of human tripronuclear (3PN) embryos

Mature oocytes were inseminated in fertilization medium (Vitrolife, Sweden) 4 h after retrieval by conventional in vitro fertilization (IVF). Fertilization status was checked 16–19 h after insemination and normal fertilization was assessed by the presence of two clear pronuclei. Abnormal fertilized oocytes with three clear pronuclear were selected for cryopreservation.

Embryo vitrification and recovery

Embryos were selected for cryopreservation using the CryoTop device as reported (Kuwayama et al., 2005). Briefly, embryos were incubated in Vitrification Solution 1 (7.5% (v/v) DMSO (v/v) and 7.5% (v/v) ethylene glycol) for 5–6 min, and then moved to Vitrification Solution 2 (15% (v/v) DMSO, 15% (v/v) ethylene glycol, and 0.65 mol/L sucrose) for 30 s. The embryos were then quickly placed onto a Cryotop (Kitazato Supply Co., Fujinomiya, Japan), followed by aspiration of excess medium with a fine pipette and quick immersion in liquid nitrogen. The embryos were then stored in liquid nitrogen. For recovery, the embryos were warmed with the polypropylene strip of the Cryotop immersed directly into 3 mL of 1.0 mol/L sucrose at 37°C for 1 min, retrieved and held for 3 min in 1 mL of a dilution solution (0.5 mol/L sucrose in TCM199 medium with 20% serum substitute supplement), and then washed at room temperature before being cultured for subsequent analysis.

Analysis of CRISPR/Cas9 induced cleavages

The T7 endonuclease 1 (T7E1) cleavage assay was performed as described by Shen et al. (Shen et al., 2014). For verification of indels and mutations, genomic DNA was used for PCR amplification of target sites with primers listed in Supplementary information, Table S1. PCR products were sequenced directly using primers from Supplementary information, Table S1 to confirm the presence of double peaks, and those with double peaks were then TA cloned into the pGEM-T vector (Promega) for sequencing. In general, a total of 45–50 clones were sequenced for each embryo.

To identify potential off-target sites, we used the online tool (http://crispr.mit.edu/). Sequences surrounding these genomic sites were PCR amplified for the T7E1 assay with primers listed in Table S1.

Whole genome amplification using embryos

Whole genome amplification of the embryos was performed using the PEPLI-g Midi Kit (Qiagen). Briefly, embryos were transferred into PCR tubes containing reconstituted buffer D2 (7 μL), and then incubated at 65°C for 10 min, before the addition of Stop solution (3.5 μL) and MDA master mix (40 μL) and incubation at 30°C for 8 h. The DNA preparation was diluted with ddH2O (3:100), and 1 μL of the diluted DNA was used for PCR analysis.

Whole-exome sequencing, data processing, and off-target analysis

The exome was captured using the 50 Mb SureSelectXT Human All Exon V5 kit (Agilent). The enriched exome was sequenced on Illumina HiSeq 2000 PE100 as paired-end 100 bp reads, which were aligned to the human reference genome (UCSC, hg19) by means of BWA with default parameters (v0.7.5a) (Li and Durbin, 2010). Samtools (v0.1.19, http://samtools.sourceforge.net) and Picard tools (version 1.102, http://picard.sourceforge.net) were used to build indices and remove duplicates. Local realignment around indels (RealignerTargetCreator, IndelRealigner) and base score recalibration (BaseRecalibrator) were applied by GATK (The Genome Analysis ToolKit, version 3.1-1) (McKenna et al., 2010) to ensure accuracy in identifying indels and single nucleotide variants (SNVs). GATK HaplotypeCaller and Samtools were used to call variants for six samples and the union variants of both obtained by CombineVariants were then divided into indels and SNVs by SelectVariants.

We first excluded indels and SNVs located outside of exon regions following annotation by ANNVAR based on RefSeq gene models (hg19) (Wang et al., 2010). A total of 7463 indels and 188,078 SNVs passed this filter. Next, indels and SNVs with more than two reads were retained by VariantFiltration and Python, discarding low-quality and unlikely indels (8.99%) and SNVs (5.91%).

To avoid false positive calls that overlap with repeat sequences and/or include homopolymers (Bansal and Libiger, 2011), we removed indels and SNVs that overlapped with low-complexity regions as defined by RepeatMasker (UCSC Genome Browser) and filtered out indels and SNVs containing homopolymers (>7 bp) in the low-complexity flanking region (±100 bp), removing 55.58% of potential indels and 17.01% of potential SNVs. To more definitively assign indels, we searched the ±100 bp regions flanking the potential indel sites for potential off-target sites. Bowtie1 (version 0.12.8, http://bowtie-bio.sourceforge.net) was used to align gRNA sequences (20 bp) to the ±100 bp sequences, allowing for ≤6 mismatches or perfect match of the last 10 nt 3′ of the gRNA. Successfully aligned sites with an NRG PAM were deemed on/off-target sites. Of the 12 candidate indels identified by this analysis, there were ten on-target indels in all samples and two off-target indels in samples A and C. Candidate off-target sites were further confirmed by PCR and sequencing. The results are summarized in Table S2.

Electronic supplementary material

The online version of this article (doi:10.1007/s13238-015-0153-5) contains supplementary material, which is available to authorized users.

Acknowledgments

This study was supported by the National Basic Research Program (973 Program) (Nos. 2010CB945401 and 2012CB911201), the National Natural Science Foundation of China (Grant Nos. 91019020, 81330055, and 31371508).

Abbreviations

3PN, tripronuclear; DSB, double strand break; gRNA, guide RNA; IVF, in vitro fertilization; HDR, homologous recombination directed repair; NHEJ, non-homologous end joining; PAM, protospacer adjacent motif; PGD, pre-implantation genetic diagnosis; SDSA, synthesis-dependent strand annealing.

Compliance with Ethics Guidelines

Puping Liang, Yanwen Xu, Xiya Zhang, Chenhui Ding, Rui Huang, Zhen Zhang, Jie Lv, Xiaowei Xie, Yuxi Chen, Yujing Li, Ying Sun, Yaofu Bai, Zhou Songyang, Wenbin Ma, Canquan Zhou, and Junjiu Huang declare that they have no conflict of interest.

This study conformed to ethical standards of Helsinki Declaration and national legislation and was approved by the Medical Ethical Committee of the First Affiliated Hospital, Sun Yat-sen University. The patients donated their tripronuclear (3PN) zygotes for research and signed informed consent forms.

References

Balakier

H

1993

Tripronuclear human zygotes: the first cell cycle and subsequent development

Hum Reprod

8

1892

1897

Baltimore

BD

,

Berg

P

,

Botchan

M

,

Carroll

D

,

Charo

RA

,

Church

G

,

Corn

JE

,

Daley

GQ

,

Doudna

JA

,

Fenner

M

et al.

2015

A prudent path forward for genomic engineering and germline gene modification

Science

348

36

38

Bansal

V

,

Libiger

O

A probabilistic method for the detection and genotyping of small indels from population-scale sequence data

Bioinformatics

2011

27

2047

2053

Bredenoord

AL

,

Pennings

G

,

de Wert

G

2008

Ooplasmic and nuclear transfer to prevent mitochondrial DNA disorders: conceptual and normative issues

Hum Reprod Update

14

669

678

Byrne

SM

,

Ortiz

L

,

Mali

P

,

Aach

J

,

Church

GM

Multi-kilobase homozygous targeted gene replacement in human induced pluripotent stem cells

Nucleic Acids Res

2014

43

e21

Cao

A

,

Galanello

R

Beta-thalassemia

Genet Med

2010

12

61

76

Chang

N

,

Sun

C

,

Gao

L

,

Zhu

D

,

Xu

X

,

Zhu

X

,

Xiong

JW

,

Xi

JJ

Genome editing with RNA-guided Cas9 nuclease in Zebrafish embryos

Cell Res

2013

23

465

472

Cho

SW

,

Kim

S

,

Kim

JM

,

Kim

JS

Targeted genome engineering in human cells with the Cas9 RNA-guided endonuclease

Nat Biotechnol

2013

31

230

232

Ciccia

A

,

Elledge

SJ

The DNA damage response: making it safe to play with knives

Mol Cell

2010

40

179

204

Cong

L

,

Ran

FA

,

Cox

D

,

Lin

S

,

Barretto

R

,

Habib

N

,

Hsu

PD

,

Wu

X

,

Jiang

W

,

Marraffini

LA

et al.

Multiplex genome engineering using CRISPR/Cas systems

Science

2013

339

819

823

Cradick

TJ

,

Fine

EJ

,

Antico

CJ

,

Bao

G

CRISPR/Cas9 systems targeting beta-globin and CCR5 genes have substantial off-target activity

Nucleic Acids Res

2013

41

9584

9592

Cyranoski

D

2015

Ethics of embryo editing divides scientists

Nature

519

272

Dean

FB

,

Hosono

S

,

Fang

L

,

Wu

X

,

Faruqi

AF

,

Bray-Ward

P

,

Sun

Z

,

Zong

Q

,

Du

Y

,

Du

J

et al.

Comprehensive human genome amplification using multiple displacement amplification

Proc Natl Acad Sci USA

2002

99

5261

5266

Friedland

AE

,

Tzur

YB

,

Esvelt

KM

,

Colaiacovo

MP

,

Church

GM

,

Calarco

JA

Heritable genome editing in C. elegans via a CRISPR-Cas9 system

Nat Methods

2013

10

741

743

Fu

Y

,

Foden

JA

,

Khayter

C

,

Maeder

ML

,

Reyon

D

,

Joung

JK

,

Sander

JD

High-frequency off-target mutagenesis induced by CRISPR-Cas nucleases in human cells

Nat Biotechnol

2013

31

822

826

Hill

RJ

,

Konigsberg

W

,

Guidotti

G

,

Craig

LC

The structure of human hemoglobin. I. The separation of the alpha and beta chains and their amino acid composition

J Biol Chem

1962

237

1549

1554

Hosono

S

,

Faruqi

AF

,

Dean

FB

,

Du

Y

,

Sun

Z

,

Wu

X

,

Du

J

,

Kingsmore

SF

,

Egholm

M

,

Lasken

RS

Unbiased whole-genome amplification directly from clinical samples

Genome Res

2003

13

954

964

Hsu

PD

,

Scott

DA

,

Weinstein

JA

,

Ran

FA

,

Konermann

S

,

Agarwala

V

,

Li

Y

,

Fine

EJ

,

Wu

X

,

Shalem

O

et al.

DNA targeting specificity of RNA-guided Cas9 nucleases

Nat Biotechnol

2013

31

827

832

Hsu

PD

,

Lander

ES

,

Zhang

F

Development and Applications of CRISPR-Cas9 for Genome Engineering

Cell

2014

157

1262

1278

Hwang

WY

,

Fu

Y

,

Reyon

D

,

Maeder

ML

,

Tsai

SQ

,

Sander

JD

,

Peterson

RT

,

Yeh

JR

,

Joung

JK

Efficient genome editing in zebrafish using a CRISPR-Cas system

Nat Biotechnol

2013

31

227

229

Ikmi

A

,

McKinney

SA

,

Delventhal

KM

,

Gibson

MC

TALEN and CRISPR/Cas9-mediated genome editing in the early-branching metazoan Nematostella vectensis

Nat Commun

2014

5

5486

Irion

U

,

Krauss

J

,

Nusslein-Volhard

C

Precise and efficient genome editing in zebrafish using the CRISPR/Cas9 system

Development

2014

141

24

4827

4830

Jinek

M

,

Chylinski

K

,

Fonfara

I

,

Hauer

M

,

Doudna

JA

,

Charpentier

E

A programmable dual-RNA-guided DNA endonuclease in adaptive bacterial immunity

Science

2012

337

816

821

Jinek

M

,

East

A

,

Cheng

A

,

Lin

S

,

Ma

E

,

Doudna

J

RNA-programmed genome editing in human cells

Elife

2013

2

e00471

Kuwayama

M

,

Vajta

G

,

Ieda

S

,

Kato

O

Comparison of open and closed methods for vitrification of human embryos and the elimination of potential contamination

Reprod Biomed Online

2005

11

608

614

Lanphier

E

,

Urnov

F

,

Haecker

SE

,

Werner

M

,

Smolenski

J

2015

Don’t edit the human germ line

Nature

519

410

411

Li

H

,

Durbin

R

Fast and accurate long-read alignment with Burrows-Wheeler transform

Bioinformatics

2010

26

589

595

Li

D

,

Qiu

Z

,

Shao

Y

,

Chen

Y

,

Guan

Y

,

Liu

M

,

Li

Y

,

Gao

N

,

Wang

L

,

Lu

X

et al.

Heritable gene targeting in the mouse and rat using a CRISPR-Cas system

Nat Biotechnol

2013

31

681

683

Li

W

,

Teng

F

,

Li

T

,

Zhou

Q

Simultaneous generation and germline transmission of multiple gene mutations in rat using CRISPR-Cas systems

Nat Biotechnol

2013

31

684

686

Long

C

,

McAnally

JR

,

Shelton

JM

,

Mireault

AA

,

Bassel-Duby

R

,

Olson

EN

Prevention of muscular dystrophy in mice by CRISPR/Cas9-mediated editing of germline DNA

Science

2014

345

1184

1188

Ma

Y

,

Zhang

X

,

Shen

B

,

Lu

Y

,

Chen

W

,

Ma

J

,

Bai

L

,

Huang

X

,

Zhang

L

Generating rats with conditional alleles using CRISPR/Cas9

Cell Res

2014

24

122

125

Mali

P

,

Aach

J

,

Stranges

PB

,

Esvelt

KM

,

Moosburner

M

,

Kosuri

S

,

Yang

L

,

Church

GM

CAS9 transcriptional activators for target specificity screening and paired nickases for cooperative genome engineering

Nat Biotechnol

2013

31

833

838

Mali

P

,

Esvelt

KM

,

Church

GM

Cas9 as a versatile tool for engineering biology

Nat Methods

2013

10

957

963

Mali

P

,

Yang

L

,

Esvelt

KM

,

Aach

J

,

Guell

M

,

DiCarlo

JE

,

Norville

JE

,

Church

GM

RNA-guided human genome engineering via Cas9

Science

2013

339

823

826

McKenna

A

,

Hanna

M

,

Banks

E

,

Sivachenko

A

,

Cibulskis

K

,

Kernytsky

A

,

Garimella

K

,

Altshuler

D

,

Gabriel

S

,

Daly

M

et al.

The Genome Analysis Toolkit: a MapReduce framework for analyzing next-generation DNA sequencing data

Genome Res

2010

20

1297

1303

Moynahan

ME

,

Jasin

M

Mitotic homologous recombination maintains genomic stability and suppresses tumorigenesis

Nat Rev Mol Cell Biol

2010

11

196

207

Munne

S

,

Cohen

J

Chromosome abnormalities in human embryos

Hum Reprod Update

1998

4

842

855

Niu

Y

,

Shen

B

,

Cui

Y

,

Chen

Y

,

Wang

J

,

Wang

L

,

Kang

Y

,

Zhao

X

,

Si

W

,

Li

W

et al.

Generation of gene-modified cynomolgus monkey via Cas9/RNA-mediated gene targeting in one-cell embryos

Cell

2014

156

836

843

Pattanayak

V

,

Lin

S

,

Guilinger

JP

,

Ma

E

,

Doudna

JA

,

Liu

DR

High-throughput profiling of off-target DNA cleavage reveals RNA-programmed Cas9 nuclease specificity

Nat Biotechnol

2013

31

839

843

San Filippo

J

,

Sung

P

,

Klein

H

Mechanism of eukaryotic homologous recombination

Annu Rev Biochem

2008

77

229

257

Sander

JD

,

Joung

JK

CRISPR-Cas systems for editing, regulating and targeting genomes

Nat Biotechnol

2014

32

347

355

Sathananthan

AH

,

Tarin

JJ

,

Gianaroli

L

,

Ng

SC

,

Dharmawardena

V

,

Magli

MC

,

Fernando

R

,

Trounson

AO

Development of the human dispermic embryo

Hum Reprod Update

1999

5

553

560

Schechter

AN

Hemoglobin research and the origins of molecular medicine

Blood

2008

112

3927

3938

Shen

B

,

Zhang

J

,

Wu

H

,

Wang

J

,

Ma

K

,

Li

Z

,

Zhang

X

,

Zhang

P

,

Huang

X

Generation of gene-modified mice via Cas9/RNA-mediated gene targeting

Cell Res

2013

23

720

723

Shen

B

,

Zhang

W

,

Zhang

J

,

Zhou

J

,

Wang

J

,

Chen

L

,

Wang

L

,

Hodgkins

A

,

Iyer

V

,

Huang

X

et al.

Efficient genome modification by CRISPR-Cas9 nickase with minimal off-target effects

Nat Methods

2014

11

399

402

Smith

C

,

Abalde-Atristain

L

,

He

C

,

Brodsky

BR

,

Braunstein

EM

,

Chaudhari

P

,

Jang

YY

,

Cheng

L

,

Ye

Z

Efficient and allele-specific genome editing of disease loci in human iPSCs

Mol Ther

2014

23

570

577

Smith

C

,

Gore

A

,

Yan

W

,

Abalde-Atristain

L

,

Li

Z

,

He

C

,

Wang

Y

,

Brodsky

RA

,

Zhang

K

,

Cheng

L

et al.

Whole-genome sequencing analysis reveals high specificity of CRISPR/Cas9 and TALEN-Based Genome Editing in Human iPSCs

Cell Stem Cell

2014

15

12

13

Suzuki

K

,

Yu

C

,

Qu

J

,

Li

M

,

Yao

X

,

Yuan

T

,

Goebl

A

,

Tang

S

,

Ren

R

,

Aizawa

E

et al.

Targeted gene correction minimally impacts whole-genome mutational load in human-disease-specific induced pluripotent stem cell clones

Cell Stem Cell

2014

15

31

36

Veres

A

,

Gosis

BS

,

Ding

Q

,

Collins

R

,

Ragavendran

A

,

Brand

H

,

Erdin

S

,

Talkowski

ME

,

Musunuru

K

Low incidence of off-target mutations in individual CRISPR-Cas9 and TALEN targeted human stem cell clones detected by whole-genome sequencing

Cell Stem Cell

2014

15

27

30

Wang

K

,

Li

M

,

Hakonarson

H

ANNOVAR: functional annotation of genetic variants from high-throughput sequencing data

Nucleic Acids Res

2010

38

e164

Wang

H

,

Yang

H

,

Shivalila

CS

,

Dawlaty

MM

,

Cheng

AW

,

Zhang

F

,

Jaenisch

R

One-step generation of mice carrying mutations in multiple genes by CRISPR/Cas-mediated genome engineering

Cell

2013

153

910

918

Wu

Y

,

Liang

D

,

Wang

Y

,

Bai

M

,

Tang

W

,

Bao

S

,

Yan

Z

,

Li

D

,

Li

J

Correction of a genetic disease in mouse via use of CRISPR-Cas9

Cell Stem Cell

2013

13

659

662

Wu

X

,

Scott

DA

,

Kriz

AJ

,

Chiu

AC

,

Hsu

PD

,

Dadon

DB

,

Cheng

AW

,

Trevino

AE

,

Konermann

S

,

Chen

S

et al.

Genome-wide binding of the CRISPR endonuclease Cas9 in mammalian cells

Nat Biotechnol

2014

32

670

676

Wu

Y

,

Zhou

H

,

Fan

X

,

Zhang

Y

,

Zhang

M

,

Wang

Y

,

Xie

Z

,

Bai

M

,

Yin

Q

,

Liang

D

et al.

Correction of a genetic disease by CRISPR-Cas9-mediated gene editing in mouse spermatogonial stem cells

Cell Res

2014

25

67

79

Yang

H

,

Wang

H

,

Shivalila

CS

,

Cheng

AW

,

Shi

L

,

Jaenisch

R

One-step generation of mice carrying reporter and conditional alleles by CRISPR/Cas-mediated genome engineering

Cell

2013

154

1370

1379

Yen

ST

,

Zhang

M

,

Deng

JM

,

Usman

SJ

,

Smith

CN

,

Parker-Thornburg

J

,

Swinton

PG

,

Martin

JF

,

Behringer

RR

Somatic mosaicism and allele complexity induced by CRISPR/Cas9 RNA injections in mouse zygotes

Dev Biol

2014

393

3

9

Author notes

Puping Liang, Yanwen Xu, Xiya Zhang and Chenhui Ding have contributed equally to this work.

© The Author(s) 2015

This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (https://creativecommons.org/licenses/by/4.0/), which permits non-commercial reuse, distribution, and reproduction in any medium, provided the original work is properly cited. For commercial re-use, please contact journals.permissions@oup.com

Supplementary data

Citations

Views

Altmetric

Metrics

Total Views 13,027

10,037 Pageviews

2,990 PDF Downloads

Since 12/1/2022

Month: Total Views:
December 2022 4
January 2023 64
February 2023 616
March 2023 1,106
April 2023 924
May 2023 825
June 2023 463
July 2023 447
August 2023 424
September 2023 708
October 2023 765
November 2023 936
December 2023 725
January 2024 644
February 2024 513
March 2024 699
April 2024 665
May 2024 596
June 2024 390
July 2024 358
August 2024 358
September 2024 476
October 2024 321

Citations

753 Web of Science

×

Email alerts

Citing articles via

More from Oxford Academic