python – 如何测试memoized函数?
我有一个简单的memoizer,我用来节省昂贵的网络电话的时间.粗略地说,我的代码看起来像这样:
# mem.py import functools import time def memoize(fn): """ Decorate a function so that it results are cached in memory. >>> import random >>> random.seed(0) >>> f = lambda x: random.randint(0,10) >>> [f(1) for _ in range(10)] [9,8,4,2,5,3,6] >>> [f(2) for _ in range(10)] [9,6,10,9] >>> g = memoize(f) >>> [g(1) for _ in range(10)] [3,3] >>> [g(2) for _ in range(10)] [8,8] """ cache = {} @functools.wraps(fn) def wrapped(*args,**kwargs): key = args,tuple(sorted(kwargs)) try: return cache[key] except KeyError: cache[key] = fn(*args,**kwargs) return cache[key] return wrapped def network_call(user_id): time.sleep(1) return 1 @memoize def search(user_id): response = network_call(user_id) # do stuff to response return response 我对这段代码进行了测试,在这里我模拟了network_call()的不同返回值,以确保我在search()中做的一些修改按预期工作. import mock import mem @mock.patch('mem.network_call') def test_search(mock_network_call): mock_network_call.return_value = 2 assert mem.search(1) == 2 @mock.patch('mem.network_call') def test_search_2(mock_network_call): mock_network_call.return_value = 3 assert mem.search(1) == 3 但是,当我运行这些测试时,我得到了一个失败,因为search()返回一个缓存的结果. CAESAR-BAUTISTA:~ caesarbautista$py.test test_mem.py ============================= test session starts ============================== platform darwin -- Python 2.7.8 -- py-1.4.26 -- pytest-2.6.4 collected 2 items test_mem.py .F =================================== FAILURES =================================== ________________________________ test_search_2 _________________________________ args = (<MagicMock name='network_call' id='4438999312'>,),keywargs = {} extra_args = [<MagicMock name='network_call' id='4438999312'>] entered_patchers = [<mock._patch object at 0x108913dd0>] exc_info = (<class '_pytest.assertion.reinterpret.AssertionError'>,AssertionError(u'assert 2 == 3n + where 2 = <function search at 0x10893f848>(1)n + where <function search at 0x10893f848> = mem.search',<traceback object at 0x1089502d8>) patching = <mock._patch object at 0x108913dd0> arg = <MagicMock name='network_call' id='4438999312'> @wraps(func) def patched(*args,**keywargs): # don't use a with here (backwards compatability with Python 2.4) extra_args = [] entered_patchers = [] # can't use try...except...finally because of Python 2.4 # compatibility exc_info = tuple() try: try: for patching in patched.patchings: arg = patching.__enter__() entered_patchers.append(patching) if patching.attribute_name is not None: keywargs.update(arg) elif patching.new is DEFAULT: extra_args.append(arg) args += tuple(extra_args) > return func(*args,**keywargs) /opt/boxen/homebrew/lib/python2.7/site-packages/mock.py:1201: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ mock_network_call = <MagicMock name='network_call' id='4438999312'> @mock.patch('mem.network_call') def test_search_2(mock_network_call): mock_network_call.return_value = 3 > assert mem.search(1) == 3 E assert 2 == 3 E + where 2 = <function search at 0x10893f848>(1) E + where <function search at 0x10893f848> = mem.search test_mem.py:15: AssertionError ====================== 1 failed,1 passed in 0.03 seconds ====================== 有没有办法测试记忆功能?我考虑了一些替代方案,但它们都有缺点. 一种解决方案是模拟memoize().我不愿意这样做,因为它泄漏了测试的实现细节.从理论上讲,我应该能够在没有系统其他部分的情况下记忆和取消默认功能,包括测试,从功能角度注意. 另一种解决方案是重写代码以公开修饰函数.也就是说,我可以这样做: def _search(user_id): return network_call(user_id) search = memoize(_search) 然而,这遇到了与上面相同的问题,尽管它可能更糟,因为它不适用于递归函数. 解决方法
是否真的需要在功能级别定义您的memoization?
这有效地使得memoized数据成为一个全局变量(就像函数一样,它的共享范围). 顺便说一下,这就是你在测试时遇到困难的原因! 那么,如何将它包装成一个对象呢? import functools import time def memoize(meth): @functools.wraps(meth) def wrapped(self,*args,**kwargs): # Prepare and get reference to cache attr = "_memo_{0}".format(meth.__name__) if not hasattr(self,attr): setattr(self,attr,{}) cache = getattr(self,attr) # Actual caching key = args,tuple(sorted(kwargs)) try: return cache[key] except KeyError: cache[key] = meth(self,**kwargs) return cache[key] return wrapped def network_call(user_id): print "Was called with: %s" % user_id return 1 class NetworkEngine(object): @memoize def search(self,user_id): return network_call(user_id) if __name__ == "__main__": e = NetworkEngine() for v in [1,1,2]: e.search(v) NetworkEngine().search(1) 产量: Was called with: 1 Was called with: 2 Was called with: 1 换句话说,NetworkEngine的每个实例都有自己的缓存.只需重用相同的一个来共享一个缓存,或者实例化一个新缓存以获得一个新的缓存. 在您的测试代码中,您将使用: @mock.patch('mem.network_call') def test_search(mock_network_call): mock_network_call.return_value = 2 assert mem.NetworkEngine().search(1) == 2 (编辑:李大同) 【声明】本站内容均来自网络,其相关言论仅代表作者个人观点,不代表本站立场。若无意侵犯到您的权利,请及时与联系站长删除相关内容! |