使用查询缓存时,Hibernate执行N + 1个选择而不是1个查询

时间:2019-02-13 15:59:46

标签: java hibernate second-level-cache query-cache select-n-plus-1

我遇到了问题,感到很迷茫,不知道该怎么办。我使用查询缓存+二级缓存,并且希望将结果正确缓存10秒钟。这是我的

ehcache.xml

<ehcache xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:noNamespaceSchemaLocation="../config/ehcache.xsd">
    <diskStore path="java.io.tmpdir"/>

    <cache name = "TestEntity"
           maxElementsInMemory="100"
           eternal="false"
           timeToLiveSeconds="11"
           memoryStoreEvictionPolicy="LRU">
    </cache>

    <cache name="org.hibernate.cache.internal.StandardQueryCache"
           maxElementsInMemory="100"
           eternal="false"
           timeToLiveSeconds="10"
           memoryStoreEvictionPolicy="LRU">
    </cache>

    <defaultCache
            maxElementsInMemory="10000"
            eternal="false"
            timeToLiveSeconds="120"
            maxElementsOnDisk="100"
            diskExpiryThreadIntervalSeconds="120"
            memoryStoreEvictionPolicy="LRU">
        <persistence strategy="localTempSwap"/>
    </defaultCache>
</ehcache>

首先,我使用 insert()方法填充数据库。 然后,我第一次调用 select()方法来获取数据。一切工作正常-查询并缓存实体,如果2秒钟后调用 select()方法,我将获得数据而无需任何数据库请求。 然后,我等待12秒(为了使缓存完全过期),请调​​用 select(),并在再次调用 select() 2秒之后。那就是我得到n + 1个选择的地方:

  

2019-02-13 18:52:17,101 [DEBUG]   org.hibernate.engine.jdbc.spi.SqlStatementLogger.logStatement(SqlStatementLogger.java:92)   选择testentity0_.id作为id1_0_0_,选择testentity0_.value作为value2_0_0_   来自测试testentity0_,其中testentity0_.id =? 2019-02-13 18:52:17,107   [DEBUG]   org.hibernate.engine.jdbc.spi.SqlStatementLogger.logStatement(SqlStatementLogger.java:92)   选择testentity0_.id作为id1_0_0_,选择testentity0_.value作为value2_0_0_   来自测试testentity0_,其中testentity0_.id =? 2019-02-13 18:52:17,108   [DEBUG]   org.hibernate.engine.jdbc.spi.SqlStatementLogger.logStatement(SqlStatementLogger.java:92)   选择testentity0_.id作为id1_0_0_,选择testentity0_.value作为value2_0_0_   来自测试testentity0_,其中testentity0_.id =? 2019-02-13 18:52:17,108   [DEBUG]   org.hibernate.engine.jdbc.spi.SqlStatementLogger.logStatement(SqlStatementLogger.java:92)   选择testentity0_.id作为id1_0_0_,选择testentity0_.value作为value2_0_0_   来自测试testentity0_,其中testentity0_.id =? 2019-02-13 18:52:17,109   [DEBUG]   org.hibernate.engine.jdbc.spi.SqlStatementLogger.logStatement(SqlStatementLogger.java:92)   选择testentity0_.id作为id1_0_0_,选择testentity0_.value作为value2_0_0_   来自测试testentity0_,其中testentity0_.id =?

我知道发出这些请求是因为查询缓存仅缓存ID,而二级缓存似乎缺少这些ID的实体。但是为什么他们不见了?启用完整日志记录后,我看到在第三次调用 select()之后,会有类似

的日志条目
  

将实体添加到二级缓存:[TestEntity#1]

因此,如果将实体添加到第二级缓存中,并且它们仅应在11秒后过期,为什么它们在2号之后就丢失了?

我的 pom.xml 的一部分:

<dependencies>
    <dependency>
        <groupId>com.h2database</groupId>
        <artifactId>h2</artifactId>
        <version>1.4.194</version>
    </dependency>

    <dependency>
        <groupId>org.hibernate</groupId>
        <artifactId>hibernate-core</artifactId>
        <version>5.2.7.Final</version>
    </dependency>

    <dependency>
        <groupId>org.hibernate</groupId>
        <artifactId>hibernate-ehcache</artifactId>
        <version>5.2.7.Final</version>
    </dependency>

    <dependency>
        <groupId>org.hibernate</groupId>
        <artifactId>hibernate-c3p0</artifactId>
        <version>5.2.7.Final</version>
    </dependency>
</dependencies>

persistence.xml

<persistence xmlns="http://java.sun.com/xml/ns/persistence"
             xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
             xsi:schemaLocation="http://java.sun.com/xml/ns/persistence http://java.sun.com/xml/ns/persistence/persistence_2_0.xsd"
             version="2.0">
    <persistence-unit name="main">
        <class>TestEntity</class>

        <exclude-unlisted-classes>true</exclude-unlisted-classes>

        <properties>
            <property name="hibernate.hbm2ddl.auto" value="create-drop"/>
            <property name="hibernate.use_sql_comments" value="true"/>
            <property name="hibernate.cache.use_second_level_cache" value="true"/>
            <property name="hibernate.cache.region.factory_class" value="org.hibernate.cache.ehcache.EhCacheRegionFactory"/>
            <property name="hibernate.cache.use_query_cache" value="true"/>
            <property name="net.sf.ehcache.configurationResourceName" value="ehcache.xml"/>
        </properties>
    </persistence-unit>
</persistence>

TestEntity.java

import org.hibernate.annotations.CacheConcurrencyStrategy;

import javax.persistence.*;

/**
 * User: Kirill Smirnov (k.smirnov@sirena2000.ru)
 * Date: 18.12.18
 * Time: 19:20
 */
@Entity
@Table(name = "test")
@Cacheable
@org.hibernate.annotations.Cache(usage = CacheConcurrencyStrategy.READ_ONLY)
public class TestEntity {
    @Id
    @GeneratedValue(generator = "test_seq")
    @SequenceGenerator(name = "test_seq", sequenceName="TEST_SEQ")
    @Column(name = "id")
    private int id;

    @Column(name = "value", nullable = false)
    private String value;

    public TestEntity() {
    }

    public TestEntity(String value) {
        this.value = value;
    }

    public int getId() {
        return id;
    }

    public void setId(int id) {
        this.id = id;
    }

    public String getValue() {
        return value;
    }

    public void setValue(String value) {
        this.value = value;
    }
}

Main.java

import javax.persistence.EntityManager;
import javax.persistence.EntityManagerFactory;
import javax.persistence.Persistence;
import javax.persistence.TypedQuery;
import java.util.Properties;

/**
 * User: Kirill Smirnov (k.smirnov@sirena2000.ru)
 * Date: 14.11.14
 * Time: 15:55
 */
public class Main {
    public static void main(String[] args) throws Exception {
        Properties entityManagerFactoryProperties = new Properties();

        entityManagerFactoryProperties.setProperty("javax.persistence.jdbc.driver", "org.h2.Driver");
        entityManagerFactoryProperties.setProperty("javax.persistence.jdbc.url", "jdbc:h2:mem:");
        entityManagerFactoryProperties.setProperty("javax.persistence.jdbc.user", "sa");
        entityManagerFactoryProperties.setProperty("javax.persistence.jdbc.password", "");
        entityManagerFactoryProperties.setProperty("hibernate.c3p0.min_size", "" + 1);
        entityManagerFactoryProperties.setProperty("hibernate.c3p0.max_size", "" + 1);
        entityManagerFactoryProperties.setProperty("hibernate.c3p0.timeout", "" + 5000);

        EntityManagerFactory entityManagerFactory = Persistence.createEntityManagerFactory("main", entityManagerFactoryProperties);

        insert(entityManagerFactory);

        select(entityManagerFactory);
        Thread.sleep(2000);
        select(entityManagerFactory);

        Thread.sleep(12000);

        select(entityManagerFactory);
        Thread.sleep(2000);
        select(entityManagerFactory);

        entityManagerFactory.close();
    }

    private static void insert(EntityManagerFactory entityManagerFactory) {
        EntityManager entityManager = entityManagerFactory.createEntityManager();

        entityManager.getTransaction().begin();
        try {
            entityManager.persist(new TestEntity("1"));
            entityManager.persist(new TestEntity("2"));
            entityManager.persist(new TestEntity("3"));
            entityManager.persist(new TestEntity("4"));
            entityManager.persist(new TestEntity("5"));
            entityManager.getTransaction().commit();
        } catch (Exception e) {
            entityManager.getTransaction().rollback();
            throw e;
        } finally {
            entityManager.close();
        }
    }

    private static void select(EntityManagerFactory entityManagerFactory) {
        EntityManager entityManager = entityManagerFactory.createEntityManager();

        entityManager.getTransaction().begin();
        try {
            String queryText = "FROM TestEntity";

            TypedQuery<TestEntity> query = entityManager.createQuery(queryText, TestEntity.class).setHint("org.hibernate.cacheable", true);
            query.getResultList();
            entityManager.getTransaction().commit();
        } catch (Exception e) {
            entityManager.getTransaction().rollback();
            throw e;
        } finally {
            entityManager.close();
        }
    }
}

P.S。我猜问题的原因是Hibernate中的错误。如果我从5.2升级到5.4,问题就消失了。但是,我接受弗拉德(Vlad)的回答,因为它通常包含有用的信息。

1 个答案:

答案 0 :(得分:2)

这是N+1 Query Cache issue

您必须确保实体缓存区域的TTL(生存时间)高于查询缓存或集合缓存的TTL。

否则,Hibernate将在查询缓存或集合缓存中找到实体标识符,并假定实体已经存储在实体缓存区域中。但是在实体缓存中找不到实体,那么只能从数据库中获取它们,因此会触发N + 1查询问题。

现在,返回您的设置。这是您为“实体缓存”区域设置的:

<cache name = "TestEntity"
       maxElementsInMemory="100"
       eternal="false"
       timeToLiveSeconds="10"
       memoryStoreEvictionPolicy="LRU">
</cache>

请注意,timeToLiveSeconds仅设置为10秒。

QueryCache的设置如下:

<cache name="org.hibernate.cache.internal.StandardQueryCache"
       maxElementsInMemory="100"
       eternal="false"
       timeToLiveSeconds="10"
       memoryStoreEvictionPolicy="LRU">
</cache>

因此timeToLiveSeconds也设置为10秒。

因此,正如我在this article中所解释的那样,您需要确保没有将实体查询缓存设置为比查询缓存和关联的集合缓存更早过期。

因此,将timeToLiveSeconds的{​​{1}}提高到TestEntity60秒。或者将其设为120,并在实体使用READ_ONLY CacheConcurrencyStartegy时禁用eternal = true

TTL