CODEWITHSUNDEEP
pythonperformancefunctionloopscall
Jose Antonio Almanza Marrero
Jose Antonio Almanza Marrero

Reputation: 49

How can I efficiently call a function in a loop with python?

I am solving a stochastic differential equation and I have a function that contains an algorithm to solve it. So I have to call that function at each time step (it is similar to Runge Kutta's method but with a random variable), then I have to solve the equation many times (since the solution is random) to be able to make averages with all the solutions . That is why I want to know how to call this function in each iteration in the most efficient way possible.

Upvotes: 2

Views: 2983

Answers (4)

PaulMcG
PaulMcG

Reputation: 63709

Some ways to optimize function calls:

  • if the function arguments and results are always the same, move the function call out of the loop
  • if some function arguments are repeated and the results for a given set of arguments are the same, use memoize or lru_cache

However, since you say that your application is a variation on Runge-Kutta, then neither of these is likely to work; you are going to have varying values of t and the modeled state vector, so you must call the function within the loop, and the values are constantly changing.

If your algorithm is slow, then it won't matter how efficient you make the function calls. Look at optimizing the function to make it run faster (or convert to Cython) - the actual call itself is not the bottleneck.

EDIT: I see that you are running this multiple times, to determine a range of values given the stochastic nature of this simulation. In that case, you should use multiprocessing to run multiple simulations on separate CPU cores - this will speed things up some.

Upvotes: 3

Jacob Faib
Jacob Faib

Reputation: 1130

Depending on your use-case it may be advantageous to use itertools.starmap(). You can think of starmap() as being the faster, multi-variable implementation of map(). You can find more information on it here. Its behavior is roughly equivalent to:

def starmap(function, iterable):
    # starmap(pow, [(2,5), (3,2), (10,3)]) --> 32 9 1000
    for args in iterable:
        yield function(*args)

so you could use it like so:

from itertools import starmap

def myAddNumbers(a,b):
    return a+b

myListOfArgTuples = [(1,2), (3,4), (5,6)]
cosmicCartograph = starmap(myAddNumbers, myListOfArgs)

Note that starmap() returns a generator object, so in order to "execute" the generator you need to instantiate it:

myResultsList = list(cosmicCartograph)
# [3, 7, 11]

or

myResultsSummed = sum(cosmicCartograph)
# 21

Upvotes: 2

pykam
pykam

Reputation: 1481

The best way to implement a function on an iterable is to use the map function.

Since map is written in C and is highly optimized, its internal implied loop can be more efficient than a regular Python for loop.

Upvotes: 2

Red
Red

Reputation: 27557

If you are using a for loop and range(), and won't be using the number that comes with each iteration, you can use an underscore to save you some efficiency:

for _ in range(100):
    print("Function call")

If you are only going to use the function in the loop, you can directly pass in the contents of the function you are using, and eliminate the defining of the function to save you some efficiency.

Upvotes: 2

Related Questions